2024-09-21T06:47:43.600 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:47:43.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:47:43.716 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913575' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJo7eGUZPh76lRh6uEuDfmIsc2RxuXPDjPOAcGTqJqTIPRLPlmo2xWucs9WoEGAA52LFYSEiFNhfOm3WgkF7uNE= smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHAlkx6h+p13X3M5ckUY1pfk5ZUwxtb1tWaagNKWOdRM62zotJnujRDgJBT1rmxrcpP4c/+6B5m8x5J/kvEzyVY= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOoXX62VrF+dPgkfsyCD56F1ku4EHx4pz+nsBqjtRPr68Iq9O3Qn5yawGi57BxX4F4Xr2ohkdlqXF8UlKDvw/Sk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:47:43.716 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:47:43.716 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:47:43.717 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:47:43.718 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:47:43.739 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:47:43.739 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:47:43.739 INFO:teuthology.packaging:ref: None 2024-09-21T06:47:43.739 INFO:teuthology.packaging:tag: None 2024-09-21T06:47:43.739 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:47:43.739 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:47:43.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:47:43.889 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:47:43.891 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:47:43.898 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:47:43.898 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:47:43.947 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:47:43.967 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:47:43.975 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:47:44.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:41:57.176094', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJo7eGUZPh76lRh6uEuDfmIsc2RxuXPDjPOAcGTqJqTIPRLPlmo2xWucs9WoEGAA52LFYSEiFNhfOm3WgkF7uNE='} 2024-09-21T06:47:44.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:41:57.173562', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHAlkx6h+p13X3M5ckUY1pfk5ZUwxtb1tWaagNKWOdRM62zotJnujRDgJBT1rmxrcpP4c/+6B5m8x5J/kvEzyVY='} 2024-09-21T06:47:44.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:41:57.174989', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOoXX62VrF+dPgkfsyCD56F1ku4EHx4pz+nsBqjtRPr68Iq9O3Qn5yawGi57BxX4F4Xr2ohkdlqXF8UlKDvw/Sk='} 2024-09-21T06:47:44.047 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:47:44.053 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T06:47:44.053 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T06:47:44.053 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T06:47:44.053 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:47:44.137 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbbef89f520>, signals=[15]) 2024-09-21T06:47:44.138 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:47:44.143 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:47:44.144 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T06:47:44.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:47:44.221 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-21T06:47:44.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:47:44.299 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-09-21T06:47:44.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:47:44.385 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:47:44.393 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-09-21T06:47:44.411 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-09-21T06:47:44.412 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-09-21T06:47:44.469 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:47:44.470 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:47:44.470 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:47:44.470 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:47:44.470 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:47:44.470 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:47:44.470 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-09-21T06:47:44.493 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-21T06:47:44.512 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-21T06:47:44.512 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-09-21T06:47:44.570 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:47:44.571 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:47:44.571 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:47:44.571 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:47:44.571 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:47:44.571 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:47:44.571 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-21T06:47:44.593 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-09-21T06:47:44.612 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-09-21T06:47:44.612 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:47:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-09-21T06:47:44.672 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:47:44.672 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:47:44.672 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:47:44.672 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:47:44.672 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:47:44.672 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:47:44.672 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-09-21T06:47:44.694 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:47:44.704 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:47:44.809 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:47:44.810 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:47:44.812 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:47:44.814 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:47:44.832 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:47:44.838 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:47:44.838 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:47:44.869 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:47:44.871 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:47:44.912 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:47:44.994 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:47:45.007 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:47:45.008 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T06:47:45.008 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:47:45.008 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:47:45.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:47:45.025 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-21T06:47:45.083 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:47:45.083 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-503.el9.x86_64 2024-09-21T06:47:45.084 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-09-21T06:47:55.493 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.3 MB 00:07 2024-09-21T06:48:12.803 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 20 MB 00:16 2024-09-21T06:48:17.406 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-21T06:48:18.991 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-21T06:48:20.230 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-21T06:48:25.880 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T06:48:26.061 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:00:01 ago on Sat 21 Sep 2024 06:48:25 AM UTC. 2024-09-21T06:48:27.879 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:48:27.879 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:48:27.984 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T06:48:28.000 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T06:48:28.000 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-09-21T06:48:28.000 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T06:48:28.000 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-09-21T06:48:28.001 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:48:28.002 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 79 M 2024-09-21T06:48:28.002 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 126 M 2024-09-21T06:48:28.002 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T06:48:28.250 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 290 kB/s | 36 kB 00:00 2024-09-21T06:48:28.575 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-21T06:48:29.217 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 32 MB/s | 35 MB 00:01 2024-09-21T06:48:29.826 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-21T06:48:29.826 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:48:29.827 INFO:teuthology.orchestra.run.smithi029.stdout:Total 43 MB/s | 79 MB 00:01 2024-09-21T06:48:30.539 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T06:48:30.961 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T06:48:30.961 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T06:48:31.930 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T06:48:31.931 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T06:48:34.492 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T06:48:35.243 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:48:35.349 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:48:38.112 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:48:38.309 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:48:43.441 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:48:43.507 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:48:48.644 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:49:30.664 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:49:30.705 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:49:31.121 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:49:31.121 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:49:31.121 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:49:31.121 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:49:32.197 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:49:32.198 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T06:49:32.631 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:49:32.739 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:49:32.739 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:49:32.739 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:49:32.739 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:49:32.739 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:49:32.739 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T06:49:32.739 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:49:32.740 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:49:32.799 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:49:32.800 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:49:32.800 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 82.el9 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-09-21T06:49:32.831 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8274670 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:49:32.832 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:49:32.833 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:49:32.833 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-09-21T06:49:32.833 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:49:32.833 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:49:32.834 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:49:32.834 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:49:32.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:49:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-09-21T06:49:35.102 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:49:35.156 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-09-21T06:49:35.159 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-21T06:49:35.173 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.pb9h89kH8t 2024-09-21T06:49:35.174 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pb9h89kH8t 2024-09-21T06:49:35.251 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.pb9h89kH8t 2024-09-21T06:49:35.400 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.pb9h89kH8t is 6KB 2024-09-21T06:49:35.448 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.pb9h89kH8t 2024-09-21T06:49:35.462 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:49:35.533 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:49:35.533 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:49:35.533 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:49:35.533 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:49:35.534 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:49:35.691 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-09-21T06:50:05.694 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:50:05.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T06:50:05.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:50:24.114 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-09-21T06:50:33.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T06:50:33.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:51:33.118 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T06:51:45.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T06:51:45.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:51:45.525 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-21T06:51:45.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T06:51:45.924 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:51:45.925 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-21T06:51:45.941 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:51:45.941 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:51:45.941 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:51:45.941 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:51:46.942 DEBUG:teuthology.parallel:result is None 2024-09-21T06:51:46.942 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:51:46.949 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:51:46.949 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:51:46.951 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:51:46.954 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:51:46.974 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:51:46.980 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:51:46.988 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:51:46.988 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:51:47.011 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:51:47.013 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:51:47.066 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:51:47.073 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:51:47.073 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:51:47.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:47.089 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:51:47.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:47.107 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:51:47.110 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:51:47.132 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:51:47.175 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:51:47.194 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:51:47.210 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:51:47.211 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:51:47.229 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:51:47.235 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:51:47.237 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:51:47.244 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:51:47.245 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:51:47.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:51:47.249 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:51:47.279 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:51:47.287 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:51:47.288 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:51:47.316 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:51:47.319 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:51:47.336 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:51:47.415 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:51:47.482 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:51:47.525 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:51:47.568 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T06:51:47.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:51:47.636 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:51:47.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:51:47.729 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:51:47.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:51:47.855 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T06:51:47.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:51:47.922 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:51:47.967 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:51:48.022 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:51:48.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:51:48.153 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T06:51:48.153 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:51:48.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-09-21T06:51:48.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-21T06:51:48.226 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-09-21T06:51:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:51:48.273 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:51:48.302 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:51:48.785 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:51:48.799 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:51:48.800 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:51:48.829 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:51:48.842 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T06:51:48.842 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-09-21T06:51:48.927 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-09-21T06:51:48.929 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-09-21T06:51:48.996 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-09-21T06:51:48.998 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-09-21T06:51:49.064 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-09-21T06:51:49.066 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:51:49.067 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-09-21T06:51:49.089 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-09-21T06:51:49.089 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-09-21T06:51:49.114 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-09-21T06:51:49.114 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-09-21T06:51:49.136 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-09-21T06:51:49.136 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:51:49.136 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:51:49.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:49.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:51:49.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:49.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:51:49.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:49.221 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:51:49.221 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:51:49.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:51:49.291 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:51:49.331 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:51:49.340 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T06:51:49.343 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T06:51:49.445 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:51:49.455 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:51:49.456 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi052.front.sepia.ceph.com,smithi066.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:55:58.110 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com')] 2024-09-21T06:55:58.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T06:55:58.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:55:58.190 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-21T06:55:58.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-21T06:55:58.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-21T06:55:58.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:55:58.349 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-21T06:55:58.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-21T06:55:58.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-21T06:55:58.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:55:58.513 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-21T06:55:58.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-21T06:55:58.596 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:55:58.606 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:55:58.606 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:55:58.607 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:55:58.609 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:55:58.610 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:55:58.612 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:55:58.612 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:55:58.642 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:55:58.642 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:55:58.657 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:55:58.659 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:55:58.668 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:55:58.684 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:55:58.684 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-09-21T06:55:58.687 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-09-21T06:55:58.696 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-09-21T06:55:58.699 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-09-21T06:55:58.710 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:55:58.715 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:55:58.718 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-09-21T06:55:58.725 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:55:58.730 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-09-21T06:55:58.733 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:55:58.748 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:55:58.764 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:55:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:55:58.785 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:55:58.785 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-21T06:55:58.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.785 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.793 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:55:58.794 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:55:58.794 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-21T06:55:58.794 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.794 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.794 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.794 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.825 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:55:58.828 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:55:58.828 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-21T06:55:58.828 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.828 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.829 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.829 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:55:58.830 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:55:58.841 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:55:58.841 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:55:58.841 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:55:58.841 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:55:58.847 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:55:58.847 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:55:58.847 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:55:58.848 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:58.849 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:55:58.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:58.850 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:55:58.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:55:58.998 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:55:58.998 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:55:59.002 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:55:59.003 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:55:59.008 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:55:59.008 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:55:59.107 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:55:59.108 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T06:55:59.108 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:55:59.114 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:55:59.114 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T06:55:59.114 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:55:59.121 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:55:59.121 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T06:55:59.121 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:55:59.136 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:55:59.136 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:55:59.141 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:55:59.141 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:55:59.147 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:55:59.147 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:55:59.204 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:55:59.208 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:55:59.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:55:59.282 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:55:59.286 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:55:59.288 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:55:59.348 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-09-21T06:55:59.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-09-21T06:55:59.352 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-09-21T06:55:59.352 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-09-21T06:55:59.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-09-21T06:55:59.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-09-21T06:55:59.585 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-09-21T06:55:59.585 INFO:teuthology.orchestra.run.smithi029.stdout:45 files removed 2024-09-21T06:55:59.590 INFO:teuthology.orchestra.run.smithi066.stdout:45 files removed 2024-09-21T06:55:59.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:55:59.613 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:55:59.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:56:00.162 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-21T06:56:00.178 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-21T06:56:00.188 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-21T06:56:00.437 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 105 kB/s | 24 kB 00:00 2024-09-21T06:56:00.471 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T06:56:00.480 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T06:56:00.705 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T06:56:00.765 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T06:56:00.879 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-09-21T06:56:01.900 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.3 MB 00:01 2024-09-21T06:56:02.496 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T06:56:02.554 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.3 MB 00:01 2024-09-21T06:56:03.829 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-21T06:56:04.447 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-21T06:56:04.580 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T06:56:08.750 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T06:56:09.093 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T06:56:10.140 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-21T06:56:10.232 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-21T06:56:10.641 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-21T06:56:11.028 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T06:56:11.545 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T06:56:11.675 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-21T06:56:12.966 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-21T06:56:17.026 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 3.6 kB/s | 1.7 kB 00:00 2024-09-21T06:56:17.151 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T06:56:18.606 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T06:56:19.272 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:56:19.273 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:56:19.287 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:56:19.288 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:56:19.289 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:56:19.290 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:56:19.292 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:56:19.295 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:56:19.296 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:56:19.364 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-21T06:56:19.372 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:56:19.374 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:56:19.378 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:56:19.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:56:19.380 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:56:19.381 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:56:19.382 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:56:19.383 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:56:19.384 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:56:19.385 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:56:19.385 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:56:19.385 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:56:19.385 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:56:19.385 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:56:19.386 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:56:19.387 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:56:19.388 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:56:19.389 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:56:19.390 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:56:19.391 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:56:19.392 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:56:19.393 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:56:19.394 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-21T06:56:19.394 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-21T06:56:19.394 INFO:teuthology.orchestra.run.smithi052.stdout:Install 149 Packages 2024-09-21T06:56:19.394 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 8 Packages 2024-09-21T06:56:19.394 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:56:19.395 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 228 M 2024-09-21T06:56:19.395 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-21T06:56:19.395 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:56:19.395 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:56:19.395 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:56:19.396 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:56:19.396 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:56:19.396 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:56:19.397 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:56:19.465 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:56:19.481 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:56:19.482 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:56:19.483 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:56:19.484 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:56:19.485 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:56:19.486 INFO:teuthology.orchestra.run.smithi066.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:56:19.487 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:56:19.488 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:56:19.489 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:56:19.490 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:56:19.491 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:56:19.492 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-09-21T06:56:19.493 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:56:19.494 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:56:19.494 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-21T06:56:19.494 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-21T06:56:19.494 INFO:teuthology.orchestra.run.smithi066.stdout:Install 149 Packages 2024-09-21T06:56:19.494 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 8 Packages 2024-09-21T06:56:19.494 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:56:19.494 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 228 M 2024-09-21T06:56:19.495 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-21T06:56:19.910 INFO:teuthology.orchestra.run.smithi052.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T06:56:19.960 INFO:teuthology.orchestra.run.smithi066.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 55 kB/s | 6.6 kB 00:00 2024-09-21T06:56:20.152 INFO:teuthology.orchestra.run.smithi052.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T06:56:20.252 INFO:teuthology.orchestra.run.smithi052.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.4 MB/s | 148 kB 00:00 2024-09-21T06:56:20.328 INFO:teuthology.orchestra.run.smithi052.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T06:56:20.361 INFO:teuthology.orchestra.run.smithi066.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.1 MB/s | 873 kB 00:00 2024-09-21T06:56:20.461 INFO:teuthology.orchestra.run.smithi066.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.4 MB/s | 148 kB 00:00 2024-09-21T06:56:20.462 INFO:teuthology.orchestra.run.smithi052.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T06:56:20.553 INFO:teuthology.orchestra.run.smithi052.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.6 MB/s | 2.3 MB 00:00 2024-09-21T06:56:20.754 INFO:teuthology.orchestra.run.smithi052.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T06:56:20.936 INFO:teuthology.orchestra.run.smithi066.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.8 MB/s | 2.3 MB 00:00 2024-09-21T06:56:20.985 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:56:20.986 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:56:20.998 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:56:20.999 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:56:21.000 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:56:21.001 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:56:21.003 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:56:21.005 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:56:21.006 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:56:21.070 INFO:teuthology.orchestra.run.smithi052.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 15 MB/s | 20 MB 00:01 2024-09-21T06:56:21.074 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-21T06:56:21.087 INFO:teuthology.orchestra.run.smithi066.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 4.4 MB/s | 5.5 MB 00:01 2024-09-21T06:56:21.105 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================= 2024-09-21T06:56:21.105 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================= 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:56:21.106 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:56:21.107 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:56:21.108 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-21T06:56:21.109 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:56:21.110 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:56:21.111 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:56:21.112 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:56:21.113 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:56:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:56:21.115 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:56:21.116 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:56:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout:======================================================================================= 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout:Install 149 Packages 2024-09-21T06:56:21.118 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 8 Packages 2024-09-21T06:56:21.119 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:56:21.119 INFO:teuthology.orchestra.run.smithi052.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 610 kB/s | 25 kB 00:00 2024-09-21T06:56:21.119 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 228 M 2024-09-21T06:56:21.119 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-21T06:56:21.154 INFO:teuthology.orchestra.run.smithi066.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-21T06:56:21.371 INFO:teuthology.orchestra.run.smithi052.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 17 MB/s | 10 MB 00:00 2024-09-21T06:56:21.421 INFO:teuthology.orchestra.run.smithi052.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.5 MB/s | 226 kB 00:00 2024-09-21T06:56:21.471 INFO:teuthology.orchestra.run.smithi052.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T06:56:21.522 INFO:teuthology.orchestra.run.smithi052.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 637 kB/s | 32 kB 00:00 2024-09-21T06:56:21.597 INFO:teuthology.orchestra.run.smithi052.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T06:56:21.655 INFO:teuthology.orchestra.run.smithi052.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T06:56:21.714 INFO:teuthology.orchestra.run.smithi052.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T06:56:21.781 INFO:teuthology.orchestra.run.smithi052.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T06:56:21.845 INFO:teuthology.orchestra.run.smithi066.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 6.6 MB/s | 5.0 MB 00:00 2024-09-21T06:56:21.967 INFO:teuthology.orchestra.run.smithi029.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-09-21T06:56:22.023 INFO:teuthology.orchestra.run.smithi052.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 22 MB/s | 5.3 MB 00:00 2024-09-21T06:56:22.082 INFO:teuthology.orchestra.run.smithi052.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 777 kB/s | 45 kB 00:00 2024-09-21T06:56:22.148 INFO:teuthology.orchestra.run.smithi052.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T06:56:22.207 INFO:teuthology.orchestra.run.smithi052.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T06:56:22.258 INFO:teuthology.orchestra.run.smithi052.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T06:56:22.310 INFO:teuthology.orchestra.run.smithi029.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.5 MB/s | 873 kB 00:00 2024-09-21T06:56:22.316 INFO:teuthology.orchestra.run.smithi052.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 5.2 MB/s | 307 kB 00:00 2024-09-21T06:56:22.354 INFO:teuthology.orchestra.run.smithi066.stdout:(8/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 15 MB/s | 18 MB 00:01 2024-09-21T06:56:22.375 INFO:teuthology.orchestra.run.smithi052.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T06:56:22.385 INFO:teuthology.orchestra.run.smithi029.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T06:56:22.404 INFO:teuthology.orchestra.run.smithi066.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 503 kB/s | 25 kB 00:00 2024-09-21T06:56:22.692 INFO:teuthology.orchestra.run.smithi052.stdout:(25/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 8.3 MB/s | 18 MB 00:02 2024-09-21T06:56:22.717 INFO:teuthology.orchestra.run.smithi052.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 253 kB/s | 86 kB 00:00 2024-09-21T06:56:22.809 INFO:teuthology.orchestra.run.smithi052.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-21T06:56:22.892 INFO:teuthology.orchestra.run.smithi052.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 412 kB/s | 34 kB 00:00 2024-09-21T06:56:22.961 INFO:teuthology.orchestra.run.smithi029.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.0 MB/s | 2.3 MB 00:00 2024-09-21T06:56:22.984 INFO:teuthology.orchestra.run.smithi052.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T06:56:23.229 INFO:teuthology.orchestra.run.smithi029.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 3.6 MB/s | 5.5 MB 00:01 2024-09-21T06:56:23.243 INFO:teuthology.orchestra.run.smithi052.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.6 MB/s | 3.1 MB 00:00 2024-09-21T06:56:23.463 INFO:teuthology.orchestra.run.smithi029.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 3.0 MB/s | 1.5 MB 00:00 2024-09-21T06:56:24.147 INFO:teuthology.orchestra.run.smithi029.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 5.4 MB/s | 5.0 MB 00:00 2024-09-21T06:56:24.177 INFO:teuthology.orchestra.run.smithi052.stdout:(31/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T06:56:24.269 INFO:teuthology.orchestra.run.smithi052.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T06:56:24.290 INFO:teuthology.orchestra.run.smithi066.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 4.3 MB/s | 10 MB 00:02 2024-09-21T06:56:24.351 INFO:teuthology.orchestra.run.smithi052.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 601 kB/s | 49 kB 00:00 2024-09-21T06:56:24.443 INFO:teuthology.orchestra.run.smithi052.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 179 kB/s | 16 kB 00:00 2024-09-21T06:56:24.474 INFO:teuthology.orchestra.run.smithi066.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.2 MB/s | 226 kB 00:00 2024-09-21T06:56:24.536 INFO:teuthology.orchestra.run.smithi052.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.0 MB/s | 285 kB 00:00 2024-09-21T06:56:24.572 INFO:teuthology.orchestra.run.smithi066.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 278 kB/s | 27 kB 00:00 2024-09-21T06:56:24.672 INFO:teuthology.orchestra.run.smithi066.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 317 kB/s | 32 kB 00:00 2024-09-21T06:56:24.869 INFO:teuthology.orchestra.run.smithi052.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 4.5 MB/s | 7.4 MB 00:01 2024-09-21T06:56:24.930 INFO:teuthology.orchestra.run.smithi066.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 2.9 MB/s | 766 kB 00:00 2024-09-21T06:56:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 222 kB/s | 18 kB 00:00 2024-09-21T06:56:25.006 INFO:teuthology.orchestra.run.smithi066.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T06:56:25.081 INFO:teuthology.orchestra.run.smithi066.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.7 MB/s | 127 kB 00:00 2024-09-21T06:56:25.223 INFO:teuthology.orchestra.run.smithi066.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 3.5 MB/s | 507 kB 00:00 2024-09-21T06:56:25.253 INFO:teuthology.orchestra.run.smithi052.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 1.1 MB/s | 784 kB 00:00 2024-09-21T06:56:25.264 INFO:teuthology.orchestra.run.smithi029.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 9.3 MB/s | 10 MB 00:01 2024-09-21T06:56:25.323 INFO:teuthology.orchestra.run.smithi029.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 431 kB/s | 25 kB 00:00 2024-09-21T06:56:25.607 INFO:teuthology.orchestra.run.smithi066.stdout:(18/157): ceph-test-19.3.0-5120.g18432218.el9.x 12 MB/s | 40 MB 00:03 2024-09-21T06:56:25.621 INFO:teuthology.orchestra.run.smithi052.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 119 kB/s | 80 kB 00:00 2024-09-21T06:56:25.657 INFO:teuthology.orchestra.run.smithi066.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 910 kB/s | 45 kB 00:00 2024-09-21T06:56:25.707 INFO:teuthology.orchestra.run.smithi066.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T06:56:25.740 INFO:teuthology.orchestra.run.smithi029.stdout:(10/157): ceph-common-19.3.0-5120.g18432218.el9 5.0 MB/s | 20 MB 00:04 2024-09-21T06:56:25.757 INFO:teuthology.orchestra.run.smithi066.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T06:56:25.808 INFO:teuthology.orchestra.run.smithi066.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T06:56:25.858 INFO:teuthology.orchestra.run.smithi066.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T06:56:25.908 INFO:teuthology.orchestra.run.smithi066.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:56:25.958 INFO:teuthology.orchestra.run.smithi066.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:56:25.995 INFO:teuthology.orchestra.run.smithi052.stdout:(40/157): ceph-test-19.3.0-5120.g18432218.el9.x 8.2 MB/s | 40 MB 00:04 2024-09-21T06:56:26.058 INFO:teuthology.orchestra.run.smithi029.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 6.9 MB/s | 18 MB 00:02 2024-09-21T06:56:26.091 INFO:teuthology.orchestra.run.smithi029.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 644 kB/s | 226 kB 00:00 2024-09-21T06:56:26.108 INFO:teuthology.orchestra.run.smithi029.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 537 kB/s | 27 kB 00:00 2024-09-21T06:56:26.134 INFO:teuthology.orchestra.run.smithi066.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 5.8 MB/s | 5.3 MB 00:00 2024-09-21T06:56:26.134 INFO:teuthology.orchestra.run.smithi029.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 752 kB/s | 32 kB 00:00 2024-09-21T06:56:26.185 INFO:teuthology.orchestra.run.smithi029.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T06:56:26.227 INFO:teuthology.orchestra.run.smithi029.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.3 MB/s | 766 kB 00:00 2024-09-21T06:56:26.261 INFO:teuthology.orchestra.run.smithi029.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T06:56:26.295 INFO:teuthology.orchestra.run.smithi029.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.3 MB/s | 507 kB 00:00 2024-09-21T06:56:26.326 INFO:teuthology.orchestra.run.smithi066.stdout:(27/157): ceph-common-19.3.0-5120.g18432218.el9 3.1 MB/s | 20 MB 00:06 2024-09-21T06:56:26.345 INFO:teuthology.orchestra.run.smithi029.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 903 kB/s | 45 kB 00:00 2024-09-21T06:56:26.351 INFO:teuthology.orchestra.run.smithi066.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 785 kB/s | 170 kB 00:00 2024-09-21T06:56:26.376 INFO:teuthology.orchestra.run.smithi066.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 688 kB/s | 34 kB 00:00 2024-09-21T06:56:26.405 INFO:teuthology.orchestra.run.smithi029.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.4 MB/s | 148 kB 00:00 2024-09-21T06:56:26.426 INFO:teuthology.orchestra.run.smithi066.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.6 MB/s | 3.1 MB 00:00 2024-09-21T06:56:26.452 INFO:teuthology.orchestra.run.smithi066.stdout:(31/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.5 MB/s | 154 kB 00:00 2024-09-21T06:56:26.464 INFO:teuthology.orchestra.run.smithi029.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T06:56:26.540 INFO:teuthology.orchestra.run.smithi029.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T06:56:26.544 INFO:teuthology.orchestra.run.smithi066.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T06:56:26.607 INFO:teuthology.orchestra.run.smithi029.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T06:56:26.610 INFO:teuthology.orchestra.run.smithi066.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 743 kB/s | 49 kB 00:00 2024-09-21T06:56:26.669 INFO:teuthology.orchestra.run.smithi066.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T06:56:26.703 INFO:teuthology.orchestra.run.smithi052.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 177 kB/s | 191 kB 00:01 2024-09-21T06:56:26.733 INFO:teuthology.orchestra.run.smithi029.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.3 MB 00:00 2024-09-21T06:56:26.753 INFO:teuthology.orchestra.run.smithi066.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.4 MB/s | 285 kB 00:00 2024-09-21T06:56:26.766 INFO:teuthology.orchestra.run.smithi029.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 625 kB/s | 99 kB 00:00 2024-09-21T06:56:26.792 INFO:teuthology.orchestra.run.smithi029.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T06:56:26.820 INFO:teuthology.orchestra.run.smithi052.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 512 kB/s | 801 kB 00:01 2024-09-21T06:56:26.854 INFO:teuthology.orchestra.run.smithi052.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 295 kB/s | 253 kB 00:00 2024-09-21T06:56:26.868 INFO:teuthology.orchestra.run.smithi029.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T06:56:26.919 INFO:teuthology.orchestra.run.smithi029.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 685 kB/s | 34 kB 00:00 2024-09-21T06:56:26.936 INFO:teuthology.orchestra.run.smithi066.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-21T06:56:26.977 INFO:teuthology.orchestra.run.smithi029.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T06:56:26.978 INFO:teuthology.orchestra.run.smithi066.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.4 MB/s | 784 kB 00:00 2024-09-21T06:56:27.003 INFO:teuthology.orchestra.run.smithi066.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 277 kB/s | 18 kB 00:00 2024-09-21T06:56:27.086 INFO:teuthology.orchestra.run.smithi029.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 9.7 MB/s | 3.1 MB 00:00 2024-09-21T06:56:27.095 INFO:teuthology.orchestra.run.smithi066.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 684 kB/s | 80 kB 00:00 2024-09-21T06:56:27.154 INFO:teuthology.orchestra.run.smithi066.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T06:56:27.182 INFO:teuthology.orchestra.run.smithi066.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-21T06:56:27.207 INFO:teuthology.orchestra.run.smithi066.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 253 kB 00:00 2024-09-21T06:56:27.257 INFO:teuthology.orchestra.run.smithi066.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-21T06:56:27.282 INFO:teuthology.orchestra.run.smithi066.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T06:56:27.308 INFO:teuthology.orchestra.run.smithi066.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:56:27.333 INFO:teuthology.orchestra.run.smithi066.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T06:56:27.358 INFO:teuthology.orchestra.run.smithi066.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.3 MB/s | 215 kB 00:00 2024-09-21T06:56:27.499 INFO:teuthology.orchestra.run.smithi066.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 4.1 MB/s | 689 kB 00:00 2024-09-21T06:56:27.533 INFO:teuthology.orchestra.run.smithi066.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 943 kB 00:00 2024-09-21T06:56:27.562 INFO:teuthology.orchestra.run.smithi052.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 144 kB/s | 106 kB 00:00 2024-09-21T06:56:27.575 INFO:teuthology.orchestra.run.smithi066.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-21T06:56:27.600 INFO:teuthology.orchestra.run.smithi066.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 326 kB/s | 22 kB 00:00 2024-09-21T06:56:27.638 INFO:teuthology.orchestra.run.smithi052.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 173 kB/s | 135 kB 00:00 2024-09-21T06:56:27.642 INFO:teuthology.orchestra.run.smithi066.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 786 kB/s | 33 kB 00:00 2024-09-21T06:56:27.653 INFO:teuthology.orchestra.run.smithi029.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-21T06:56:27.676 INFO:teuthology.orchestra.run.smithi066.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-21T06:56:27.718 INFO:teuthology.orchestra.run.smithi066.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-21T06:56:27.720 INFO:teuthology.orchestra.run.smithi029.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T06:56:27.760 INFO:teuthology.orchestra.run.smithi066.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-21T06:56:27.779 INFO:teuthology.orchestra.run.smithi029.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 844 kB/s | 49 kB 00:00 2024-09-21T06:56:27.827 INFO:teuthology.orchestra.run.smithi066.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-21T06:56:27.894 INFO:teuthology.orchestra.run.smithi066.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T06:56:27.936 INFO:teuthology.orchestra.run.smithi066.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T06:56:28.127 INFO:teuthology.orchestra.run.smithi066.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-21T06:56:28.279 INFO:teuthology.orchestra.run.smithi052.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 174 kB/s | 125 kB 00:00 2024-09-21T06:56:28.311 INFO:teuthology.orchestra.run.smithi066.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-21T06:56:28.368 INFO:teuthology.orchestra.run.smithi066.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 432 kB/s | 24 kB 00:00 2024-09-21T06:56:28.403 INFO:teuthology.orchestra.run.smithi066.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2024-09-21T06:56:28.467 INFO:teuthology.orchestra.run.smithi029.stdout:(34/157): ceph-test-19.3.0-5120.g18432218.el9.x 13 MB/s | 40 MB 00:03 2024-09-21T06:56:28.480 INFO:teuthology.orchestra.run.smithi052.stdout:(47/157): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-21T06:56:28.495 INFO:teuthology.orchestra.run.smithi066.stdout:(63/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-09-21T06:56:28.545 INFO:teuthology.orchestra.run.smithi066.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-21T06:56:28.555 INFO:teuthology.orchestra.run.smithi052.stdout:(48/157): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-09-21T06:56:28.574 INFO:teuthology.orchestra.run.smithi029.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 21 kB/s | 16 kB 00:00 2024-09-21T06:56:28.587 INFO:teuthology.orchestra.run.smithi066.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-21T06:56:28.613 INFO:teuthology.orchestra.run.smithi066.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-21T06:56:28.613 INFO:teuthology.orchestra.run.smithi052.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-21T06:56:28.616 INFO:teuthology.orchestra.run.smithi029.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 1.9 MB/s | 285 kB 00:00 2024-09-21T06:56:28.638 INFO:teuthology.orchestra.run.smithi052.stdout:(50/157): python3-urllib3-1.26.5-6.el9.noarch.r 215 kB/s | 215 kB 00:01 2024-09-21T06:56:28.664 INFO:teuthology.orchestra.run.smithi052.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 443 kB/s | 22 kB 00:00 2024-09-21T06:56:28.706 INFO:teuthology.orchestra.run.smithi052.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 786 kB/s | 33 kB 00:00 2024-09-21T06:56:28.765 INFO:teuthology.orchestra.run.smithi052.stdout:(53/157): python3-cryptography-36.0.1-4.el9.x86 609 kB/s | 1.2 MB 00:02 2024-09-21T06:56:28.840 INFO:teuthology.orchestra.run.smithi052.stdout:(54/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-21T06:56:28.865 INFO:teuthology.orchestra.run.smithi052.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-21T06:56:28.867 INFO:teuthology.orchestra.run.smithi029.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 7.5 MB/s | 14 MB 00:01 2024-09-21T06:56:28.890 INFO:teuthology.orchestra.run.smithi052.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T06:56:28.892 INFO:teuthology.orchestra.run.smithi029.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 67 kB/s | 18 kB 00:00 2024-09-21T06:56:28.916 INFO:teuthology.orchestra.run.smithi052.stdout:(57/157): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-21T06:56:28.934 INFO:teuthology.orchestra.run.smithi029.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 2.1 MB/s | 784 kB 00:00 2024-09-21T06:56:28.940 INFO:teuthology.orchestra.run.smithi052.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T06:56:28.974 INFO:teuthology.orchestra.run.smithi052.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-09-21T06:56:29.017 INFO:teuthology.orchestra.run.smithi052.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-21T06:56:29.050 INFO:teuthology.orchestra.run.smithi052.stdout:(61/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-21T06:56:29.075 INFO:teuthology.orchestra.run.smithi052.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-21T06:56:29.085 INFO:teuthology.orchestra.run.smithi029.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 366 kB/s | 80 kB 00:00 2024-09-21T06:56:29.117 INFO:teuthology.orchestra.run.smithi052.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-21T06:56:29.130 INFO:teuthology.orchestra.run.smithi066.stdout:(67/157): ceph-mgr-dashboard-19.3.0-5120.g18432 5.1 MB/s | 14 MB 00:02 2024-09-21T06:56:29.136 INFO:teuthology.orchestra.run.smithi029.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 951 kB/s | 191 kB 00:00 2024-09-21T06:56:29.142 INFO:teuthology.orchestra.run.smithi052.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-21T06:56:29.176 INFO:teuthology.orchestra.run.smithi052.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T06:56:29.201 INFO:teuthology.orchestra.run.smithi052.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-21T06:56:29.203 INFO:teuthology.orchestra.run.smithi029.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T06:56:29.235 INFO:teuthology.orchestra.run.smithi052.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T06:56:29.245 INFO:teuthology.orchestra.run.smithi029.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-21T06:56:29.270 INFO:teuthology.orchestra.run.smithi029.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 106 kB 00:00 2024-09-21T06:56:29.305 INFO:teuthology.orchestra.run.smithi029.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-21T06:56:29.327 INFO:teuthology.orchestra.run.smithi052.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T06:56:29.347 INFO:teuthology.orchestra.run.smithi029.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-21T06:56:29.372 INFO:teuthology.orchestra.run.smithi029.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-21T06:56:29.406 INFO:teuthology.orchestra.run.smithi029.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-21T06:56:29.411 INFO:teuthology.orchestra.run.smithi052.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-21T06:56:29.461 INFO:teuthology.orchestra.run.smithi052.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-21T06:56:29.519 INFO:teuthology.orchestra.run.smithi066.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 4.8 MB/s | 1.6 MB 00:00 2024-09-21T06:56:29.525 INFO:teuthology.orchestra.run.smithi029.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 902 kB/s | 107 kB 00:00 2024-09-21T06:56:29.567 INFO:teuthology.orchestra.run.smithi029.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-21T06:56:29.586 INFO:teuthology.orchestra.run.smithi052.stdout:(71/157): postgresql-server-13.16-1.el9.x86_64. 46 MB/s | 5.8 MB 00:00 2024-09-21T06:56:29.593 INFO:teuthology.orchestra.run.smithi029.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 322 kB/s | 22 kB 00:00 2024-09-21T06:56:29.628 INFO:teuthology.orchestra.run.smithi052.stdout:(72/157): postgresql-13.16-1.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-09-21T06:56:29.643 INFO:teuthology.orchestra.run.smithi029.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-21T06:56:29.662 INFO:teuthology.orchestra.run.smithi052.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T06:56:29.669 INFO:teuthology.orchestra.run.smithi029.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 432 kB/s | 33 kB 00:00 2024-09-21T06:56:29.687 INFO:teuthology.orchestra.run.smithi052.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T06:56:29.703 INFO:teuthology.orchestra.run.smithi029.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-21T06:56:29.722 INFO:teuthology.orchestra.run.smithi066.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-21T06:56:29.728 INFO:teuthology.orchestra.run.smithi029.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 308 kB/s | 18 kB 00:00 2024-09-21T06:56:29.737 INFO:teuthology.orchestra.run.smithi052.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T06:56:29.754 INFO:teuthology.orchestra.run.smithi029.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 219 kB/s | 11 kB 00:00 2024-09-21T06:56:29.796 INFO:teuthology.orchestra.run.smithi029.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-21T06:56:29.797 INFO:teuthology.orchestra.run.smithi066.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-21T06:56:29.821 INFO:teuthology.orchestra.run.smithi052.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-21T06:56:29.839 INFO:teuthology.orchestra.run.smithi066.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-21T06:56:29.854 INFO:teuthology.orchestra.run.smithi052.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T06:56:29.897 INFO:teuthology.orchestra.run.smithi029.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-21T06:56:29.921 INFO:teuthology.orchestra.run.smithi052.stdout:(78/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.6 MB/s | 4.9 MB 00:00 2024-09-21T06:56:29.922 INFO:teuthology.orchestra.run.smithi029.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 953 kB/s | 160 kB 00:00 2024-09-21T06:56:29.946 INFO:teuthology.orchestra.run.smithi052.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-21T06:56:29.956 INFO:teuthology.orchestra.run.smithi029.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 283 kB/s | 45 kB 00:00 2024-09-21T06:56:29.963 INFO:teuthology.orchestra.run.smithi052.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-21T06:56:29.980 INFO:teuthology.orchestra.run.smithi052.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 574 kB/s | 19 kB 00:00 2024-09-21T06:56:29.990 INFO:teuthology.orchestra.run.smithi029.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 8.4 MB/s | 581 kB 00:00 2024-09-21T06:56:30.006 INFO:teuthology.orchestra.run.smithi052.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T06:56:30.016 INFO:teuthology.orchestra.run.smithi029.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 414 kB/s | 24 kB 00:00 2024-09-21T06:56:30.031 INFO:teuthology.orchestra.run.smithi052.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 518 kB/s | 35 kB 00:00 2024-09-21T06:56:30.051 INFO:teuthology.orchestra.run.smithi029.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.2 MB/s | 662 kB 00:00 2024-09-21T06:56:30.073 INFO:teuthology.orchestra.run.smithi052.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T06:56:30.076 INFO:teuthology.orchestra.run.smithi029.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 552 kB/s | 47 kB 00:00 2024-09-21T06:56:30.089 INFO:teuthology.orchestra.run.smithi066.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.3 MB/s | 4.9 MB 00:01 2024-09-21T06:56:30.111 INFO:teuthology.orchestra.run.smithi029.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T06:56:30.127 INFO:teuthology.orchestra.run.smithi029.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 761 kB/s | 38 kB 00:00 2024-09-21T06:56:30.140 INFO:teuthology.orchestra.run.smithi052.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-21T06:56:30.148 INFO:teuthology.orchestra.run.smithi066.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T06:56:30.161 INFO:teuthology.orchestra.run.smithi029.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-21T06:56:30.165 INFO:teuthology.orchestra.run.smithi052.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-09-21T06:56:30.190 INFO:teuthology.orchestra.run.smithi052.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 660 kB/s | 77 kB 00:00 2024-09-21T06:56:30.198 INFO:teuthology.orchestra.run.smithi066.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-21T06:56:30.215 INFO:teuthology.orchestra.run.smithi052.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 561 kB/s | 42 kB 00:00 2024-09-21T06:56:30.232 INFO:teuthology.orchestra.run.smithi066.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-21T06:56:30.249 INFO:teuthology.orchestra.run.smithi052.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-09-21T06:56:30.274 INFO:teuthology.orchestra.run.smithi052.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T06:56:30.287 INFO:teuthology.orchestra.run.smithi029.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-21T06:56:30.308 INFO:teuthology.orchestra.run.smithi052.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-21T06:56:30.323 INFO:teuthology.orchestra.run.smithi066.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-21T06:56:30.325 INFO:teuthology.orchestra.run.smithi052.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 673 kB/s | 51 kB 00:00 2024-09-21T06:56:30.350 INFO:teuthology.orchestra.run.smithi052.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-21T06:56:30.375 INFO:teuthology.orchestra.run.smithi052.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-21T06:56:30.396 INFO:teuthology.orchestra.run.smithi029.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-21T06:56:30.401 INFO:teuthology.orchestra.run.smithi052.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-09-21T06:56:30.415 INFO:teuthology.orchestra.run.smithi066.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-09-21T06:56:30.443 INFO:teuthology.orchestra.run.smithi052.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 867 kB/s | 36 kB 00:00 2024-09-21T06:56:30.446 INFO:teuthology.orchestra.run.smithi029.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-21T06:56:30.449 INFO:teuthology.orchestra.run.smithi066.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 770 kB/s | 26 kB 00:00 2024-09-21T06:56:30.468 INFO:teuthology.orchestra.run.smithi052.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T06:56:30.480 INFO:teuthology.orchestra.run.smithi029.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-21T06:56:30.483 INFO:teuthology.orchestra.run.smithi066.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 570 kB/s | 19 kB 00:00 2024-09-21T06:56:30.485 INFO:teuthology.orchestra.run.smithi052.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T06:56:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-21T06:56:30.522 INFO:teuthology.orchestra.run.smithi029.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 3.8 MB/s | 910 kB 00:00 2024-09-21T06:56:30.552 INFO:teuthology.orchestra.run.smithi052.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-21T06:56:30.558 INFO:teuthology.orchestra.run.smithi066.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-21T06:56:30.573 INFO:teuthology.orchestra.run.smithi029.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-21T06:56:30.586 INFO:teuthology.orchestra.run.smithi052.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-21T06:56:30.591 INFO:teuthology.orchestra.run.smithi066.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-09-21T06:56:30.602 INFO:teuthology.orchestra.run.smithi052.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T06:56:30.607 INFO:teuthology.orchestra.run.smithi029.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T06:56:30.620 INFO:teuthology.orchestra.run.smithi052.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-21T06:56:30.649 INFO:teuthology.orchestra.run.smithi029.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T06:56:30.767 INFO:teuthology.orchestra.run.smithi029.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-09-21T06:56:30.800 INFO:teuthology.orchestra.run.smithi029.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-21T06:56:30.836 INFO:teuthology.orchestra.run.smithi029.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.5 MB/s | 248 kB 00:00 2024-09-21T06:56:30.861 INFO:teuthology.orchestra.run.smithi029.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 423 kB/s | 26 kB 00:00 2024-09-21T06:56:30.879 INFO:teuthology.orchestra.run.smithi029.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 453 kB/s | 19 kB 00:00 2024-09-21T06:56:30.904 INFO:teuthology.orchestra.run.smithi029.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-21T06:56:30.921 INFO:teuthology.orchestra.run.smithi029.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 823 kB/s | 35 kB 00:00 2024-09-21T06:56:31.047 INFO:teuthology.orchestra.run.smithi029.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-21T06:56:31.081 INFO:teuthology.orchestra.run.smithi029.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-21T06:56:31.115 INFO:teuthology.orchestra.run.smithi029.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-21T06:56:31.137 INFO:teuthology.orchestra.run.smithi052.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-21T06:56:31.140 INFO:teuthology.orchestra.run.smithi029.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T06:56:31.166 INFO:teuthology.orchestra.run.smithi029.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 836 kB/s | 42 kB 00:00 2024-09-21T06:56:31.187 INFO:teuthology.orchestra.run.smithi052.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:56:31.208 INFO:teuthology.orchestra.run.smithi029.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-21T06:56:31.212 INFO:teuthology.orchestra.run.smithi052.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T06:56:31.237 INFO:teuthology.orchestra.run.smithi052.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T06:56:31.242 INFO:teuthology.orchestra.run.smithi029.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-09-21T06:56:31.271 INFO:teuthology.orchestra.run.smithi052.stdout:(108/157): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-21T06:56:31.276 INFO:teuthology.orchestra.run.smithi029.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.0 MB/s | 279 kB 00:00 2024-09-21T06:56:31.301 INFO:teuthology.orchestra.run.smithi029.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 864 kB/s | 51 kB 00:00 2024-09-21T06:56:31.313 INFO:teuthology.orchestra.run.smithi052.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-21T06:56:31.327 INFO:teuthology.orchestra.run.smithi029.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:56:31.338 INFO:teuthology.orchestra.run.smithi052.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:56:31.363 INFO:teuthology.orchestra.run.smithi052.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:56:31.389 INFO:teuthology.orchestra.run.smithi052.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:56:31.439 INFO:teuthology.orchestra.run.smithi052.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T06:56:31.446 INFO:teuthology.orchestra.run.smithi029.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.4 MB/s | 5.1 MB 00:00 2024-09-21T06:56:31.471 INFO:teuthology.orchestra.run.smithi029.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 289 kB/s | 42 kB 00:00 2024-09-21T06:56:31.481 INFO:teuthology.orchestra.run.smithi052.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T06:56:31.497 INFO:teuthology.orchestra.run.smithi029.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-09-21T06:56:31.500 INFO:teuthology.orchestra.run.smithi066.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-21T06:56:31.506 INFO:teuthology.orchestra.run.smithi052.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi029.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.6 MB/s | 221 kB 00:00 2024-09-21T06:56:31.531 INFO:teuthology.orchestra.run.smithi052.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:56:31.556 INFO:teuthology.orchestra.run.smithi029.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 606 kB/s | 36 kB 00:00 2024-09-21T06:56:31.582 INFO:teuthology.orchestra.run.smithi029.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 938 kB/s | 47 kB 00:00 2024-09-21T06:56:31.590 INFO:teuthology.orchestra.run.smithi052.stdout:(117/157): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T06:56:31.592 INFO:teuthology.orchestra.run.smithi066.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-21T06:56:31.615 INFO:teuthology.orchestra.run.smithi052.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-21T06:56:31.616 INFO:teuthology.orchestra.run.smithi029.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.0 MB/s | 304 kB 00:00 2024-09-21T06:56:31.640 INFO:teuthology.orchestra.run.smithi052.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-21T06:56:31.641 INFO:teuthology.orchestra.run.smithi029.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 981 kB/s | 58 kB 00:00 2024-09-21T06:56:31.666 INFO:teuthology.orchestra.run.smithi052.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T06:56:31.675 INFO:teuthology.orchestra.run.smithi029.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T06:56:31.675 INFO:teuthology.orchestra.run.smithi066.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-21T06:56:31.699 INFO:teuthology.orchestra.run.smithi052.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T06:56:31.700 INFO:teuthology.orchestra.run.smithi029.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T06:56:31.725 INFO:teuthology.orchestra.run.smithi052.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T06:56:31.726 INFO:teuthology.orchestra.run.smithi029.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 886 kB/s | 45 kB 00:00 2024-09-21T06:56:31.726 INFO:teuthology.orchestra.run.smithi066.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:56:31.759 INFO:teuthology.orchestra.run.smithi066.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-21T06:56:31.767 INFO:teuthology.orchestra.run.smithi052.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-21T06:56:31.800 INFO:teuthology.orchestra.run.smithi052.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 321 kB/s | 11 kB 00:00 2024-09-21T06:56:31.801 INFO:teuthology.orchestra.run.smithi029.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-21T06:56:31.825 INFO:teuthology.orchestra.run.smithi052.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T06:56:31.851 INFO:teuthology.orchestra.run.smithi052.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-21T06:56:31.860 INFO:teuthology.orchestra.run.smithi029.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T06:56:31.876 INFO:teuthology.orchestra.run.smithi052.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-21T06:56:31.893 INFO:teuthology.orchestra.run.smithi066.stdout:(87/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.4 MB/s | 6.0 MB 00:01 2024-09-21T06:56:31.901 INFO:teuthology.orchestra.run.smithi052.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-21T06:56:31.918 INFO:teuthology.orchestra.run.smithi066.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-21T06:56:31.951 INFO:teuthology.orchestra.run.smithi052.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-21T06:56:31.977 INFO:teuthology.orchestra.run.smithi066.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-21T06:56:31.977 INFO:teuthology.orchestra.run.smithi052.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:56:32.002 INFO:teuthology.orchestra.run.smithi052.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:56:32.010 INFO:teuthology.orchestra.run.smithi066.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-09-21T06:56:32.028 INFO:teuthology.orchestra.run.smithi052.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:56:32.069 INFO:teuthology.orchestra.run.smithi052.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-21T06:56:32.094 INFO:teuthology.orchestra.run.smithi066.stdout:(91/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.4 MB/s | 5.1 MB 00:01 2024-09-21T06:56:32.094 INFO:teuthology.orchestra.run.smithi052.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-21T06:56:32.119 INFO:teuthology.orchestra.run.smithi066.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-09-21T06:56:32.120 INFO:teuthology.orchestra.run.smithi052.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-21T06:56:32.136 INFO:teuthology.orchestra.run.smithi066.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-09-21T06:56:32.144 INFO:teuthology.orchestra.run.smithi029.stdout:(106/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-21T06:56:32.153 INFO:teuthology.orchestra.run.smithi066.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-21T06:56:32.153 INFO:teuthology.orchestra.run.smithi052.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 851 kB/s | 28 kB 00:00 2024-09-21T06:56:32.170 INFO:teuthology.orchestra.run.smithi066.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T06:56:32.178 INFO:teuthology.orchestra.run.smithi052.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-21T06:56:32.204 INFO:teuthology.orchestra.run.smithi066.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-21T06:56:32.204 INFO:teuthology.orchestra.run.smithi029.stdout:(107/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-21T06:56:32.204 INFO:teuthology.orchestra.run.smithi052.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T06:56:32.229 INFO:teuthology.orchestra.run.smithi052.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:56:32.237 INFO:teuthology.orchestra.run.smithi029.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-21T06:56:32.245 INFO:teuthology.orchestra.run.smithi066.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T06:56:32.254 INFO:teuthology.orchestra.run.smithi052.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:56:32.272 INFO:teuthology.orchestra.run.smithi029.stdout:(109/157): gperftools-libs-2.9.1-3.el9.x86_64.r 747 kB/s | 308 kB 00:00 2024-09-21T06:56:32.280 INFO:teuthology.orchestra.run.smithi052.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T06:56:32.287 INFO:teuthology.orchestra.run.smithi066.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-21T06:56:32.298 INFO:teuthology.orchestra.run.smithi029.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 443 kB/s | 26 kB 00:00 2024-09-21T06:56:32.305 INFO:teuthology.orchestra.run.smithi052.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:56:32.323 INFO:teuthology.orchestra.run.smithi029.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 961 kB/s | 49 kB 00:00 2024-09-21T06:56:32.329 INFO:teuthology.orchestra.run.smithi066.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T06:56:32.330 INFO:teuthology.orchestra.run.smithi052.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:56:32.356 INFO:teuthology.orchestra.run.smithi052.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:56:32.357 INFO:teuthology.orchestra.run.smithi029.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-21T06:56:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T06:56:32.388 INFO:teuthology.orchestra.run.smithi066.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-21T06:56:32.391 INFO:teuthology.orchestra.run.smithi029.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-21T06:56:32.406 INFO:teuthology.orchestra.run.smithi052.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T06:56:32.413 INFO:teuthology.orchestra.run.smithi066.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-21T06:56:32.431 INFO:teuthology.orchestra.run.smithi052.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T06:56:32.442 INFO:teuthology.orchestra.run.smithi029.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T06:56:32.455 INFO:teuthology.orchestra.run.smithi066.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 64 kB 00:00 2024-09-21T06:56:32.481 INFO:teuthology.orchestra.run.smithi066.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-21T06:56:32.481 INFO:teuthology.orchestra.run.smithi052.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T06:56:32.484 INFO:teuthology.orchestra.run.smithi029.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-21T06:56:32.552 INFO:teuthology.orchestra.run.smithi029.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 399 kB/s | 43 kB 00:00 2024-09-21T06:56:32.577 INFO:teuthology.orchestra.run.smithi029.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 349 kB/s | 32 kB 00:00 2024-09-21T06:56:32.602 INFO:teuthology.orchestra.run.smithi029.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-21T06:56:32.636 INFO:teuthology.orchestra.run.smithi029.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-09-21T06:56:32.670 INFO:teuthology.orchestra.run.smithi029.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T06:56:32.712 INFO:teuthology.orchestra.run.smithi029.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-21T06:56:32.723 INFO:teuthology.orchestra.run.smithi052.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-21T06:56:32.746 INFO:teuthology.orchestra.run.smithi029.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-21T06:56:32.764 INFO:teuthology.orchestra.run.smithi066.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-21T06:56:32.780 INFO:teuthology.orchestra.run.smithi029.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T06:56:32.799 INFO:teuthology.orchestra.run.smithi029.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 580 kB/s | 11 kB 00:00 2024-09-21T06:56:32.814 INFO:teuthology.orchestra.run.smithi066.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:56:32.824 INFO:teuthology.orchestra.run.smithi029.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 703 kB/s | 18 kB 00:00 2024-09-21T06:56:32.839 INFO:teuthology.orchestra.run.smithi066.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T06:56:32.850 INFO:teuthology.orchestra.run.smithi029.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 916 kB/s | 23 kB 00:00 2024-09-21T06:56:32.865 INFO:teuthology.orchestra.run.smithi066.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T06:56:32.876 INFO:teuthology.orchestra.run.smithi029.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 773 kB/s | 19 kB 00:00 2024-09-21T06:56:32.882 INFO:teuthology.orchestra.run.smithi052.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 3.4 MB 00:00 2024-09-21T06:56:32.901 INFO:teuthology.orchestra.run.smithi029.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 779 kB/s | 20 kB 00:00 2024-09-21T06:56:32.999 INFO:teuthology.orchestra.run.smithi066.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-21T06:56:33.002 INFO:teuthology.orchestra.run.smithi029.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.0 MB/s | 2.0 MB 00:00 2024-09-21T06:56:33.024 INFO:teuthology.orchestra.run.smithi066.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:56:33.027 INFO:teuthology.orchestra.run.smithi029.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:56:33.049 INFO:teuthology.orchestra.run.smithi066.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:56:33.074 INFO:teuthology.orchestra.run.smithi066.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:56:33.078 INFO:teuthology.orchestra.run.smithi029.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-21T06:56:33.100 INFO:teuthology.orchestra.run.smithi066.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:56:33.104 INFO:teuthology.orchestra.run.smithi029.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-21T06:56:33.129 INFO:teuthology.orchestra.run.smithi029.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T06:56:33.150 INFO:teuthology.orchestra.run.smithi066.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T06:56:33.155 INFO:teuthology.orchestra.run.smithi029.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 649 kB/s | 16 kB 00:00 2024-09-21T06:56:33.184 INFO:teuthology.orchestra.run.smithi066.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T06:56:33.188 INFO:teuthology.orchestra.run.smithi029.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.1 MB/s | 272 kB 00:00 2024-09-21T06:56:33.209 INFO:teuthology.orchestra.run.smithi066.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:56:33.214 INFO:teuthology.orchestra.run.smithi029.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T06:56:33.240 INFO:teuthology.orchestra.run.smithi029.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 554 kB/s | 28 kB 00:00 2024-09-21T06:56:33.243 INFO:teuthology.orchestra.run.smithi066.stdout:(116/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-21T06:56:33.268 INFO:teuthology.orchestra.run.smithi066.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-21T06:56:33.293 INFO:teuthology.orchestra.run.smithi066.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-21T06:56:33.327 INFO:teuthology.orchestra.run.smithi066.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 14 MB/s | 358 kB 00:00 2024-09-21T06:56:33.342 INFO:teuthology.orchestra.run.smithi029.stdout:(138/157): libarrow-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-21T06:56:33.359 INFO:teuthology.orchestra.run.smithi029.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 212 kB/s | 31 kB 00:00 2024-09-21T06:56:33.360 INFO:teuthology.orchestra.run.smithi066.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.5 MB/s | 303 kB 00:00 2024-09-21T06:56:33.376 INFO:teuthology.orchestra.run.smithi029.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-21T06:56:33.385 INFO:teuthology.orchestra.run.smithi066.stdout:(121/157): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-09-21T06:56:33.393 INFO:teuthology.orchestra.run.smithi029.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-21T06:56:33.411 INFO:teuthology.orchestra.run.smithi066.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:56:33.419 INFO:teuthology.orchestra.run.smithi029.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-21T06:56:33.436 INFO:teuthology.orchestra.run.smithi066.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T06:56:33.450 INFO:teuthology.orchestra.run.smithi029.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 899 kB/s | 188 kB 00:00 2024-09-21T06:56:33.461 INFO:teuthology.orchestra.run.smithi066.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T06:56:33.484 INFO:teuthology.orchestra.run.smithi029.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.4 MB/s | 90 kB 00:00 2024-09-21T06:56:33.487 INFO:teuthology.orchestra.run.smithi066.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-21T06:56:33.512 INFO:teuthology.orchestra.run.smithi066.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 937 kB/s | 23 kB 00:00 2024-09-21T06:56:33.537 INFO:teuthology.orchestra.run.smithi066.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-09-21T06:56:33.547 INFO:teuthology.orchestra.run.smithi029.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-09-21T06:56:33.562 INFO:teuthology.orchestra.run.smithi066.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T06:56:33.569 INFO:teuthology.orchestra.run.smithi029.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 237 kB/s | 20 kB 00:00 2024-09-21T06:56:33.602 INFO:teuthology.orchestra.run.smithi029.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.4 MB/s | 191 kB 00:00 2024-09-21T06:56:33.621 INFO:teuthology.orchestra.run.smithi066.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-21T06:56:33.628 INFO:teuthology.orchestra.run.smithi029.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-09-21T06:56:33.646 INFO:teuthology.orchestra.run.smithi066.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:56:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:(131/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.7 MB/s | 2.0 MB 00:00 2024-09-21T06:56:33.697 INFO:teuthology.orchestra.run.smithi029.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T06:56:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T06:56:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-21T06:56:33.749 INFO:teuthology.orchestra.run.smithi052.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:01 2024-09-21T06:56:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 654 kB/s | 16 kB 00:00 2024-09-21T06:56:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.6 MB/s | 90 kB 00:00 2024-09-21T06:56:33.806 INFO:teuthology.orchestra.run.smithi066.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T06:56:33.832 INFO:teuthology.orchestra.run.smithi066.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-21T06:56:33.857 INFO:teuthology.orchestra.run.smithi066.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-21T06:56:33.882 INFO:teuthology.orchestra.run.smithi066.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:56:33.882 INFO:teuthology.orchestra.run.smithi052.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:00 2024-09-21T06:56:33.904 INFO:teuthology.orchestra.run.smithi029.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 11 MB/s | 3.4 MB 00:00 2024-09-21T06:56:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:56:33.941 INFO:teuthology.orchestra.run.smithi066.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 608 kB/s | 36 kB 00:00 2024-09-21T06:56:33.966 INFO:teuthology.orchestra.run.smithi066.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-21T06:56:33.992 INFO:teuthology.orchestra.run.smithi066.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:56:34.017 INFO:teuthology.orchestra.run.smithi066.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:56:34.042 INFO:teuthology.orchestra.run.smithi066.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-21T06:56:34.063 INFO:teuthology.orchestra.run.smithi029.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.3 MB/s | 3.2 MB 00:00 2024-09-21T06:56:34.067 INFO:teuthology.orchestra.run.smithi066.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T06:56:34.101 INFO:teuthology.orchestra.run.smithi066.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T06:56:34.160 INFO:teuthology.orchestra.run.smithi066.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T06:56:34.205 INFO:teuthology.orchestra.run.smithi029.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 288 kB/s | 41 kB 00:00 2024-09-21T06:56:34.316 INFO:teuthology.orchestra.run.smithi052.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 72 kB/s | 41 kB 00:00 2024-09-21T06:56:34.322 INFO:teuthology.orchestra.run.smithi029.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T06:56:34.360 INFO:teuthology.orchestra.run.smithi066.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T06:56:34.439 INFO:teuthology.orchestra.run.smithi029.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.2 MB/s | 2.3 MB 00:00 2024-09-21T06:56:34.490 INFO:teuthology.orchestra.run.smithi029.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.1 MB/s | 1.8 MB 00:00 2024-09-21T06:56:34.535 INFO:teuthology.orchestra.run.smithi066.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T06:56:34.607 INFO:teuthology.orchestra.run.smithi029.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 1.4 MB 00:00 2024-09-21T06:56:34.610 INFO:teuthology.orchestra.run.smithi066.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-21T06:56:34.642 INFO:teuthology.orchestra.run.smithi052.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 328 kB/s | 249 kB 00:00 2024-09-21T06:56:34.661 INFO:teuthology.orchestra.run.smithi066.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.3 MB/s | 3.2 MB 00:00 2024-09-21T06:56:34.677 INFO:teuthology.orchestra.run.smithi066.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 613 kB/s | 41 kB 00:00 2024-09-21T06:56:34.736 INFO:teuthology.orchestra.run.smithi066.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-21T06:56:34.761 INFO:teuthology.orchestra.run.smithi066.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-21T06:56:34.820 INFO:teuthology.orchestra.run.smithi066.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-21T06:56:35.259 INFO:teuthology.orchestra.run.smithi052.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-21T06:56:35.642 INFO:teuthology.orchestra.run.smithi052.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:00 2024-09-21T06:56:35.676 INFO:teuthology.orchestra.run.smithi029.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 2.4 MB 00:01 2024-09-21T06:56:35.683 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:56:35.683 INFO:teuthology.orchestra.run.smithi029.stdout:Total 16 MB/s | 228 MB 00:14 2024-09-21T06:56:36.970 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-21T06:56:37.139 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-21T06:56:37.139 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-21T06:56:37.237 INFO:teuthology.orchestra.run.smithi066.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-21T06:56:37.242 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:56:37.242 INFO:teuthology.orchestra.run.smithi066.stdout:Total 13 MB/s | 228 MB 00:17 2024-09-21T06:56:38.067 INFO:teuthology.orchestra.run.smithi052.stdout:(157/157): protobuf-compiler-3.14.0-13.el9.x86_ 116 kB/s | 863 kB 00:07 2024-09-21T06:56:38.073 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:56:38.073 INFO:teuthology.orchestra.run.smithi052.stdout:Total 12 MB/s | 228 MB 00:18 2024-09-21T06:56:38.509 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-21T06:56:38.678 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-21T06:56:38.678 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-21T06:56:39.326 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-21T06:56:39.496 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-21T06:56:39.496 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-21T06:56:39.609 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-21T06:56:39.610 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-21T06:56:40.617 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-21T06:56:40.617 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-21T06:56:41.408 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-21T06:56:41.409 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-21T06:56:46.440 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-21T06:56:46.608 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:56:46.663 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:56:46.735 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:56:46.787 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:56:46.829 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:56:46.888 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:56:47.234 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-21T06:56:47.251 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:56:47.341 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:56:47.380 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:56:47.433 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:56:47.466 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:56:47.467 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:56:47.492 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:56:47.536 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:56:47.604 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:56:47.644 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:56:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:56:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:56:47.791 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-21T06:56:47.814 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:56:47.901 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:56:47.929 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:56:47.993 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:56:48.024 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:56:48.075 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:56:48.086 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:56:48.122 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:56:48.239 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:56:48.250 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:56:48.274 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:56:48.341 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:56:48.354 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:56:48.372 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:56:48.418 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:56:48.418 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:56:48.441 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:56:48.465 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:56:48.494 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:56:48.587 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:56:48.615 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:56:48.641 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:56:48.645 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:56:48.776 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:56:48.812 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:56:48.872 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:56:48.874 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:56:48.897 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:56:48.899 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:56:49.007 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:56:49.033 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:56:49.035 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:56:49.049 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:56:49.065 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:56:49.087 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:56:49.109 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:56:49.136 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:56:49.158 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:56:49.175 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:49.187 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:56:49.216 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:56:49.304 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:49.312 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:56:49.377 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:56:49.426 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:56:49.435 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:56:49.453 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:56:49.551 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:49.553 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:56:49.565 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:56:49.588 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:56:49.648 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:49.650 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:56:49.666 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:56:49.672 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:56:49.693 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:56:49.700 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:56:49.733 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:49.746 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:56:49.831 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:56:49.891 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:56:49.898 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:56:49.942 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:56:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:50.000 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:56:50.035 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:56:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:56:50.075 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:56:50.087 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:56:50.113 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:56:50.148 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:56:50.154 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:56:50.169 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:56:50.233 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:56:50.238 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:56:50.258 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:50.276 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:56:50.283 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:56:50.320 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:56:50.322 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:56:50.330 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:50.366 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:56:50.398 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:56:50.404 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:56:50.426 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:56:50.448 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:56:50.501 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:56:50.502 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:56:50.538 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:56:50.562 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:56:50.563 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:56:50.590 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:56:50.620 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:56:50.627 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:56:50.673 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:56:50.710 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:56:50.711 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:56:50.742 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:56:50.754 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:56:50.758 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:56:50.777 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:56:50.798 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:56:50.826 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:56:50.847 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:56:50.899 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:56:50.900 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:56:50.905 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:56:50.938 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:56:50.950 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:56:50.961 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:56:50.982 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:56:51.014 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:56:51.028 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:56:51.042 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:56:51.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:56:51.174 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:56:51.174 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:56:51.212 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:56:51.228 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:56:51.255 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:56:51.339 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:56:51.375 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:56:51.418 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:56:51.447 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:56:51.519 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:56:51.527 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:56:51.570 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:56:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:56:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:56:51.663 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:56:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:56:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:56:51.790 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:56:51.816 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:56:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:56:51.873 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:56:51.883 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:56:51.917 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:56:51.961 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:56:51.999 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:56:52.041 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:56:52.219 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:56:52.277 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:56:52.372 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:56:52.425 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:56:52.434 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:56:52.511 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:56:52.516 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:56:52.547 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:56:52.553 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:56:52.590 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:56:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:56:52.597 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:56:52.628 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:56:52.654 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:56:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:56:52.669 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:56:52.688 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:56:52.732 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:56:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:56:52.774 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:56:52.834 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:56:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:56:52.904 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:56:52.919 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:56:52.924 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:56:52.959 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:56:52.969 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:56:52.998 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:56:53.001 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:56:53.014 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:56:53.061 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:56:53.071 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:56:53.108 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:56:53.115 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:56:53.134 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:56:53.150 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:56:53.169 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:56:53.172 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:56:53.190 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:56:53.208 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:56:53.220 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:56:53.224 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:56:53.248 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:56:53.256 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:56:53.300 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:56:53.327 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:56:53.343 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:56:53.372 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:56:53.388 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:56:53.423 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:56:53.465 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:56:53.482 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:56:53.506 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:56:53.534 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:56:53.536 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:56:53.568 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:56:53.578 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:56:53.608 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:56:53.615 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:56:53.620 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:56:53.648 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:56:53.660 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:56:53.685 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:56:53.717 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:56:53.720 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:56:53.726 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:56:53.751 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:56:53.753 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:56:53.770 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:56:53.784 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:56:53.804 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:56:53.818 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:56:53.838 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:56:53.843 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:56:53.868 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:56:53.896 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:56:53.930 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:56:53.945 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:56:53.977 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:56:54.016 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:56:54.038 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:56:54.074 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:56:54.090 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:56:54.109 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:56:54.126 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:56:54.127 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:56:54.136 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:56:54.170 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:56:54.171 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:56:54.193 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:56:54.219 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:56:54.220 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:56:54.250 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:56:54.269 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:56:54.280 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:56:54.307 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:56:54.314 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:56:54.342 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:56:54.348 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:56:54.376 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:56:54.389 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:56:54.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:56:54.427 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:56:54.470 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:56:54.513 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:56:54.562 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:56:54.571 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:56:54.611 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:56:54.612 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:56:54.652 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:56:54.717 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:56:54.769 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:56:54.770 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:56:54.839 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:56:54.963 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:56:55.014 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:56:55.048 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:56:55.152 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:56:55.212 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:56:55.266 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:56:55.356 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:56:55.400 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:56:55.526 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:56:55.585 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:56:55.591 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:56:55.613 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:56:55.619 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:56:55.631 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:56:55.679 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:56:55.710 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:56:55.721 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:56:55.722 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:56:55.783 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:56:55.826 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:56:55.828 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:56:55.889 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:56:55.934 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:56:55.942 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:56:55.971 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:56:56.035 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:56:56.087 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:56:56.161 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:56:56.194 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:56:56.281 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:56:56.286 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:56:56.319 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:56:56.399 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:56:56.407 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:56:56.526 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:56:56.963 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:56:57.087 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:56:57.106 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:56:57.247 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:56:57.845 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:56:57.926 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:56:57.954 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:56:57.987 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:56:58.329 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:56:58.368 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:56:58.391 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:56:58.463 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:56:58.483 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:56:58.492 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:56:58.521 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:56:58.566 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:56:58.572 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:56:58.624 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:56:58.715 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:56:58.752 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:56:58.786 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:56:59.092 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:56:59.110 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:56:59.119 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:56:59.130 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:56:59.154 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:56:59.190 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:56:59.191 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:56:59.220 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:56:59.254 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:56:59.284 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:56:59.294 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:56:59.320 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:56:59.341 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:56:59.386 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:56:59.847 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:56:59.874 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:56:59.925 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:56:59.945 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:56:59.967 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:57:00.318 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:57:00.396 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:57:00.435 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:57:01.563 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:01.600 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:02.200 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:02.245 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:57:02.333 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:57:02.333 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:57:02.333 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:57:02.334 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:02.345 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:02.363 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:57:02.380 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:02.913 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:02.956 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:02.977 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:03.016 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:57:03.107 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:57:03.107 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:57:03.108 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:57:03.108 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:03.134 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:57:03.573 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:57:03.621 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:57:03.719 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:57:03.719 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:57:03.719 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:57:03.719 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:03.792 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:57:14.639 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:57:14.639 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-09-21T06:57:14.640 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-09-21T06:57:14.640 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-09-21T06:57:14.640 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-09-21T06:57:14.640 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-09-21T06:57:14.640 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-09-21T06:57:14.640 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-09-21T06:57:14.640 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:14.816 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:57:14.833 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:57:14.833 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:14.833 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:57:14.833 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:15.476 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:57:15.476 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-09-21T06:57:15.476 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-09-21T06:57:15.476 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-09-21T06:57:15.476 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-09-21T06:57:15.476 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-09-21T06:57:15.476 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-09-21T06:57:15.477 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-09-21T06:57:15.477 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:15.653 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:57:15.670 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:57:15.671 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:15.671 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:57:15.671 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:16.478 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:57:16.506 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:57:16.506 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:16.506 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:57:16.506 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:57:16.506 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:57:16.506 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:16.745 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:57:16.769 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:57:16.770 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:16.770 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:57:16.770 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:57:16.770 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:57:16.770 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:17.263 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:57:17.287 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:57:17.287 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:17.287 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:57:17.288 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:57:17.288 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:57:17.288 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:17.314 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:57:17.341 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:57:17.341 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:17.342 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:57:17.342 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:57:17.342 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:57:17.342 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:17.402 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:57:17.460 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:57:17.524 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:57:17.573 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:57:17.596 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:57:17.597 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:17.597 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:57:17.597 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:57:17.597 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:57:17.597 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:17.728 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:57:17.781 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:57:17.861 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:57:17.952 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:57:18.099 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:57:18.105 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:57:18.123 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:57:18.123 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:18.123 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:57:18.123 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:57:18.123 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:57:18.123 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:18.147 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:57:18.179 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:57:18.206 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:57:18.229 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:57:18.287 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:57:18.343 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:57:18.542 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:57:18.579 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:57:18.591 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:57:18.613 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:57:18.645 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:57:18.688 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:57:18.715 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:57:18.744 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:57:18.785 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:57:18.943 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:57:18.983 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:57:19.015 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:57:19.050 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:57:19.444 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:57:19.474 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:57:19.507 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:57:19.575 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:57:19.606 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:57:19.851 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:57:19.851 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-09-21T06:57:19.851 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-09-21T06:57:19.851 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-09-21T06:57:19.851 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-09-21T06:57:19.852 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-09-21T06:57:19.852 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-09-21T06:57:19.852 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-09-21T06:57:19.852 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:20.044 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:57:20.062 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:57:20.062 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:20.062 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:57:20.062 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:21.726 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:57:21.754 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:57:21.754 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:21.754 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:57:21.755 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:57:21.755 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:57:21.755 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:22.003 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:57:22.028 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:57:22.028 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:22.028 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:57:22.029 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:57:22.029 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:57:22.029 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:22.133 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:57:22.191 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:57:22.530 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:57:22.555 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:57:22.555 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:22.555 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:57:22.555 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:57:22.555 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:57:22.555 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:22.679 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:57:22.746 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:57:22.819 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:57:22.968 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:57:23.021 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:57:23.028 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:57:23.088 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:57:23.178 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:57:23.204 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:57:23.233 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:57:23.277 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:57:23.358 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:57:23.431 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:57:23.484 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:57:23.525 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:57:23.533 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:57:23.560 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:57:23.561 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:57:23.585 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:57:23.586 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:23.586 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:57:23.586 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:57:23.586 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:57:23.586 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:23.637 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:57:23.648 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:57:23.751 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:57:23.811 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:57:23.980 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:57:24.016 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:57:24.042 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:57:24.058 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:57:24.078 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:57:24.135 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:57:24.174 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:57:24.197 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:57:24.370 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:57:24.397 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:57:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:57:24.421 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:24.421 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:57:24.421 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:57:24.421 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:57:24.421 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:24.472 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:57:24.484 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:57:24.587 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:57:24.638 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:57:24.827 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:57:24.855 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:57:24.880 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:57:24.880 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:24.881 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:57:24.881 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:57:24.881 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:57:24.881 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:24.922 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:57:24.947 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:57:24.947 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:24.947 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:57:24.947 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:24.998 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:57:25.023 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:57:25.023 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:25.023 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:57:25.023 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:57:25.023 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:57:25.023 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:25.357 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:57:25.382 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:57:25.383 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:25.383 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:57:25.383 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:57:25.383 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:57:25.383 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:25.656 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:57:25.691 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:57:25.715 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:57:25.715 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:25.715 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:57:25.715 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:57:25.715 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:57:25.715 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:25.767 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:57:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:57:25.790 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:25.790 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:57:25.790 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:25.842 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:57:25.866 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:57:25.866 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:25.866 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:57:25.866 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:57:25.866 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:57:25.866 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:26.210 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:57:26.233 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:57:26.233 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:26.233 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:57:26.234 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:57:26.234 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:57:26.234 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:27.550 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:57:27.631 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:57:28.647 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:57:28.673 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:57:28.794 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:57:28.975 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:57:29.012 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:57:29.037 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:57:29.037 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:29.038 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:57:29.038 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:57:29.038 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:57:29.038 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:29.089 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:57:29.100 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:57:29.212 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:57:29.283 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:57:29.587 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:57:29.629 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:57:29.678 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:57:29.717 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:57:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:57:29.943 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:57:29.983 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:57:30.013 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:57:30.043 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:57:30.080 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:57:30.324 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:57:30.360 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:57:30.385 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:57:30.385 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:30.385 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:57:30.385 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:57:30.385 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:57:30.386 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:30.428 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:57:30.439 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:57:30.452 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:57:30.452 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:30.452 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:57:30.453 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:30.481 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:57:30.514 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:57:30.521 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:57:30.539 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:57:30.539 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:30.539 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:57:30.540 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:57:30.540 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:57:30.540 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:57:30.580 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:57:30.623 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:30.661 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:30.683 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:57:30.818 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:57:30.848 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:57:30.878 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:57:30.882 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:57:30.907 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:57:30.907 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:57:30.907 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:57:30.907 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:57:30.907 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:57:30.907 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:30.933 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:57:31.621 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:57:31.657 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:31.697 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:31.707 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:57:31.717 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:31.749 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:57:31.842 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:57:31.877 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:57:31.902 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:57:31.928 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:57:31.928 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:57:31.995 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:57:31.996 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:57:32.079 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:57:32.104 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:57:32.110 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:32.110 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:32.298 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:32.298 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:57:32.390 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:57:32.457 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:32.608 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:57:32.701 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:57:32.743 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:57:32.826 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:57:32.854 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:57:32.887 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:57:32.913 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:57:32.913 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:57:32.998 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:57:32.998 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:57:33.065 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:57:33.090 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:57:33.095 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:33.095 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:33.275 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:33.275 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:57:33.367 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:57:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:35.193 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:57:35.243 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:57:35.292 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:57:35.334 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:57:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:57:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:57:35.658 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:57:35.688 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:57:35.719 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:57:35.774 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:57:36.437 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:36.490 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:36.511 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:57:37.406 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:57:37.532 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:57:37.593 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:57:37.707 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:57:37.749 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:57:37.783 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:57:37.826 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:57:37.827 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:57:37.938 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:57:37.938 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:57:38.023 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:57:38.056 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:57:38.062 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:38.063 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:38.259 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:57:38.259 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:57:38.352 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:57:38.439 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:38.515 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:57:38.516 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:57:38.517 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:57:38.518 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:57:38.519 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:57:38.520 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:57:38.521 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:57:38.522 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:57:38.523 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:57:38.524 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:57:38.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:57:38.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:57:38.527 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:57:38.527 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:57:38.527 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:57:39.757 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:57:39.758 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:57:39.759 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:57:39.759 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:57:39.759 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:57:39.759 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:57:39.773 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:57:39.773 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:57:39.773 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:57:39.773 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:57:39.773 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:57:39.773 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:57:39.774 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:57:39.775 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:57:39.776 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:57:39.777 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:57:39.778 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:57:39.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:57:39.780 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:57:39.781 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:57:39.782 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:57:39.783 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:57:39.783 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:57:39.783 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:57:39.783 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:57:39.783 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:57:39.783 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:57:41.328 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:41.328 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:41.328 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-09-21T06:57:41.328 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:57:41.329 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.330 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:57:41.331 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:57:41.332 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:57:41.333 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:57:41.334 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:57:41.335 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:57:41.336 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:57:41.337 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:57:41.338 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:41.339 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T06:57:41.340 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-21T06:57:41.746 DEBUG:teuthology.parallel:result is None 2024-09-21T06:57:42.627 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:57:42.628 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.629 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:57:42.630 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.631 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:57:42.632 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:57:42.633 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:57:42.634 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:57:42.635 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:57:42.636 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:57:42.637 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:57:42.638 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:57:42.639 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:57:42.640 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T06:57:42.640 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-21T06:57:43.178 DEBUG:teuthology.parallel:result is None 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:57:50.038 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:57:50.039 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:57:50.040 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:57:50.041 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:57:50.042 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:57:50.043 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:57:50.044 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:57:50.045 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:57:50.046 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:57:50.047 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:57:50.048 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:57:50.049 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:57:50.050 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:57:50.051 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:57:50.052 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:57:50.052 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:57:50.052 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:57:50.052 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:57:50.052 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:57:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:52.779 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:57:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:57:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:57:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:57:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:57:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:57:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:57:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:57:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:57:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:57:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:57:52.791 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-21T06:57:53.313 DEBUG:teuthology.parallel:result is None 2024-09-21T06:57:53.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:53.454 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:57:53.478 INFO:teuthology.orchestra.run.smithi029.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:57:53.478 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:57:53.478 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:57:53.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:53.619 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:57:53.646 INFO:teuthology.orchestra.run.smithi052.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:57:53.646 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:57:53.646 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:57:53.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:53.790 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:57:53.818 INFO:teuthology.orchestra.run.smithi066.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:57:53.818 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:57:53.818 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:57:53.820 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:57:53.820 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T06:57:53.820 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:57:53.851 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T06:57:53.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:57:53.883 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T06:57:53.883 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:57:53.917 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:57:53.917 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T06:57:53.917 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:57:53.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:57:54.013 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T06:57:54.013 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:57:54.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:57:54.109 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T06:57:54.110 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:57:54.140 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:57:54.210 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:57:54.210 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T06:57:54.210 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:57:54.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:57:54.306 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T06:57:54.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:57:54.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:57:54.401 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T06:57:54.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:57:54.427 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:57:54.493 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:57:54.493 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T06:57:54.494 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:57:54.522 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:57:54.590 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T06:57:54.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:57:54.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:57:54.680 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T06:57:54.680 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:57:54.713 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:57:54.778 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T06:57:54.870 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T06:57:54.870 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:54.871 INFO:tasks.cephadm:Cluster fsid is d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:57:54.871 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T06:57:54.871 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.29', 'mon.b': '172.21.15.52', 'mon.c': '172.21.15.66'} 2024-09-21T06:57:54.871 INFO:tasks.cephadm:First mon is mon.a on smithi029 2024-09-21T06:57:54.871 INFO:tasks.cephadm:First mgr is x 2024-09-21T06:57:54.871 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T06:57:54.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname $(hostname -s) 2024-09-21T06:57:54.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname $(hostname -s) 2024-09-21T06:57:54.928 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname $(hostname -s) 2024-09-21T06:57:54.954 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T06:57:54.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:55.098 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T06:57:55.239 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:55.240 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:57:55.241 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:57:55.241 DEBUG:teuthology.orchestra.run.smithi029:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:55.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:57 /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:55.804 DEBUG:teuthology.orchestra.run.smithi052:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:56.319 INFO:teuthology.orchestra.run.smithi052.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:57 /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:56.319 DEBUG:teuthology.orchestra.run.smithi066:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:56.830 INFO:teuthology.orchestra.run.smithi066.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:57 /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:56.831 DEBUG:teuthology.orchestra.run.smithi029:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:56.851 DEBUG:teuthology.orchestra.run.smithi052:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:56.871 DEBUG:teuthology.orchestra.run.smithi066:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:57:56.914 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T06:57:56.914 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:57:56.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:57:56.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:57:58.476 INFO:teuthology.orchestra.run.smithi066.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:57:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:57:59.741 INFO:teuthology.orchestra.run.smithi029.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:58:29.708 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T06:58:29.708 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:58:29.708 INFO:teuthology.orchestra.run.smithi029.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:58:29.708 INFO:teuthology.orchestra.run.smithi029.stdout: "repo_digests": [ 2024-09-21T06:58:29.708 INFO:teuthology.orchestra.run.smithi029.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:58:29.708 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T06:58:29.708 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T06:58:33.319 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-21T06:58:33.320 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:58:33.320 INFO:teuthology.orchestra.run.smithi052.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:58:33.320 INFO:teuthology.orchestra.run.smithi052.stdout: "repo_digests": [ 2024-09-21T06:58:33.320 INFO:teuthology.orchestra.run.smithi052.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:58:33.320 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-21T06:58:33.320 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-21T06:58:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-21T06:58:33.666 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:58:33.667 INFO:teuthology.orchestra.run.smithi066.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:58:33.667 INFO:teuthology.orchestra.run.smithi066.stdout: "repo_digests": [ 2024-09-21T06:58:33.667 INFO:teuthology.orchestra.run.smithi066.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:58:33.667 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-21T06:58:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-21T06:58:33.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph 2024-09-21T06:58:33.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph 2024-09-21T06:58:33.760 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph 2024-09-21T06:58:33.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /etc/ceph 2024-09-21T06:58:33.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /etc/ceph 2024-09-21T06:58:33.847 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /etc/ceph 2024-09-21T06:58:33.873 INFO:tasks.cephadm:Writing seed config... 2024-09-21T06:58:33.875 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T06:58:33.875 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T06:58:33.875 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T06:58:33.876 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T06:58:33.876 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T06:58:33.876 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T06:58:33.876 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T06:58:33.876 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T06:58:33.876 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T06:58:33.876 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T06:58:33.877 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T06:58:33.877 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T06:58:33.877 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T06:58:33.877 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T06:58:33.877 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T06:58:33.877 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T06:58:33.877 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T06:58:33.878 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T06:58:33.878 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:58:33.878 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T06:58:33.878 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T06:58:33.878 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T06:58:33.878 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T06:58:33.879 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T06:58:33.879 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T06:58:33.880 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T06:58:33.880 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T06:58:33.901 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d3a42dd8-77e6-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T06:58:33.901 DEBUG:teuthology.orchestra.run.smithi029:mon.a> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T06:58:33.946 DEBUG:teuthology.orchestra.run.smithi029:mgr.x> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T06:58:33.990 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T06:58:33.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.29 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:58:34.209 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:58:34.209 INFO:teuthology.orchestra.run.smithi029.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.29', '--skip-admin-label'] 2024-09-21T06:58:34.209 INFO:teuthology.orchestra.run.smithi029.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T06:58:34.210 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying podman|docker is present... 2024-09-21T06:58:34.235 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:58:34.236 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying lvm2 is present... 2024-09-21T06:58:34.236 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying time synchronization is in place... 2024-09-21T06:58:34.243 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:58:34.243 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:58:34.250 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:58:34.250 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-21T06:58:34.256 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout enabled 2024-09-21T06:58:34.263 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout active 2024-09-21T06:58:34.263 INFO:teuthology.orchestra.run.smithi029.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:58:34.263 INFO:teuthology.orchestra.run.smithi029.stdout:Repeating the final host check... 2024-09-21T06:58:34.286 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:58:34.286 INFO:teuthology.orchestra.run.smithi029.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T06:58:34.286 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl is present 2024-09-21T06:58:34.286 INFO:teuthology.orchestra.run.smithi029.stdout:lvcreate is present 2024-09-21T06:58:34.293 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:58:34.293 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:58:34.299 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:58:34.299 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-21T06:58:34.306 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout enabled 2024-09-21T06:58:34.313 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout active 2024-09-21T06:58:34.313 INFO:teuthology.orchestra.run.smithi029.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:58:34.313 INFO:teuthology.orchestra.run.smithi029.stdout:Host looks OK 2024-09-21T06:58:34.313 INFO:teuthology.orchestra.run.smithi029.stdout:Cluster fsid: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:58:34.313 INFO:teuthology.orchestra.run.smithi029.stdout:Acquiring lock 140677445888656 on /run/cephadm/d3a42dd8-77e6-11ef-baf5-efdc52797490.lock 2024-09-21T06:58:34.314 INFO:teuthology.orchestra.run.smithi029.stdout:Lock 140677445888656 acquired on /run/cephadm/d3a42dd8-77e6-11ef-baf5-efdc52797490.lock 2024-09-21T06:58:34.314 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying IP 172.21.15.29 port 3300 ... 2024-09-21T06:58:34.314 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying IP 172.21.15.29 port 6789 ... 2024-09-21T06:58:34.314 INFO:teuthology.orchestra.run.smithi029.stdout:Base mon IP(s) is [172.21.15.29:3300, 172.21.15.29:6789], mon addrv is [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2024-09-21T06:58:34.317 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.29 metric 100 2024-09-21T06:58:34.317 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.29 metric 100 2024-09-21T06:58:34.320 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T06:58:34.320 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T06:58:34.320 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2024-09-21T06:58:34.322 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T06:58:34.322 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T06:58:34.323 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:58:34.323 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T06:58:34.323 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-09-21T06:58:34.323 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:58:34.324 INFO:teuthology.orchestra.run.smithi029.stdout:Mon IP `172.21.15.29` is in CIDR network `172.21.0.0/20` 2024-09-21T06:58:34.324 INFO:teuthology.orchestra.run.smithi029.stdout:Mon IP `172.21.15.29` is in CIDR network `172.21.0.0/20` 2024-09-21T06:58:34.324 INFO:teuthology.orchestra.run.smithi029.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T06:58:34.324 INFO:teuthology.orchestra.run.smithi029.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T06:58:34.324 INFO:teuthology.orchestra.run.smithi029.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:58:34.823 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:58:34.824 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:58:34.824 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T06:58:34.824 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T06:58:34.824 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T06:58:34.824 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:58:34.824 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T06:58:35.827 INFO:teuthology.orchestra.run.smithi029.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:58:35.827 INFO:teuthology.orchestra.run.smithi029.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:58:35.827 INFO:teuthology.orchestra.run.smithi029.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T06:58:44.286 INFO:teuthology.orchestra.run.smithi029.stdout:stat: stdout 167 167 2024-09-21T06:58:44.286 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial keys... 2024-09-21T06:59:00.404 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQCobu5mVEOYIBAAKYIqc8xHLmolGxQd4iCbnA== 2024-09-21T06:59:01.493 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQC0bu5mfE6MMBAAm2IsutU8IIQIUgFllNjzdw== 2024-09-21T06:59:02.514 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQC1bu5mXZfXMBAAzmBziZFEV954DEtmGCSD+g== 2024-09-21T06:59:02.515 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial monmap... 2024-09-21T06:59:03.469 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:59:03.469 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T06:59:03.469 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:03.469 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:59:03.470 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool for a [v2:172.21.15.29:3300,v1:172.21.15.29:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:59:03.470 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-09-21T06:59:03.470 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: set fsid to d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:03.470 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:59:03.470 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T06:59:03.470 INFO:teuthology.orchestra.run.smithi029.stdout:Creating mon... 2024-09-21T06:59:04.499 INFO:teuthology.orchestra.run.smithi029.stdout:create mon.a on 2024-09-21T06:59:04.709 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T06:59:04.861 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T06:59:05.063 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490.target. 2024-09-21T06:59:05.063 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490.target. 2024-09-21T06:59:05.320 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:59:05.321 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T06:59:05.489 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490.target.wants/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@.service. 2024-09-21T06:59:06.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:05 smithi029 podman[30599]: 2024-09-21 06:59:05.631021372 +0000 UTC m=+0.016901390 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:06.547 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:06 smithi029 podman[30599]: 2024-09-21 06:59:06.246046282 +0000 UTC m=+0.631926287 container create 1b7c54b6638b29970b9b746107a304050e0f09f6175a250ef378882f2b7d7df5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T06:59:06.548 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:06 smithi029 podman[30599]: 2024-09-21 06:59:06.485093587 +0000 UTC m=+0.870973601 container init 1b7c54b6638b29970b9b746107a304050e0f09f6175a250ef378882f2b7d7df5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:59:06.548 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:06 smithi029 podman[30599]: 2024-09-21 06:59:06.488590749 +0000 UTC m=+0.874470754 container start 1b7c54b6638b29970b9b746107a304050e0f09f6175a250ef378882f2b7d7df5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:59:06.592 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:59:06.592 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-21T06:59:06.599 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:59:06.600 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-21T06:59:06.600 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-21T06:59:06.600 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:59:06.600 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mon to start... 2024-09-21T06:59:06.600 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mon... 2024-09-21T06:59:06.813 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:06 smithi029 ceph-mon[30617]: mkfs d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:06.813 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:06 smithi029 ceph-mon[30617]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:59:06.813 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:06 smithi029 bash[30599]: 1b7c54b6638b29970b9b746107a304050e0f09f6175a250ef378882f2b7d7df5 2024-09-21T06:59:06.813 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:06 smithi029 systemd[1]: Started Ceph mon.a for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:59:07.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout id: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout services: 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.537794s) 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:07.649 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout data: 2024-09-21T06:59:07.650 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T06:59:07.650 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T06:59:07.650 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T06:59:07.650 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T06:59:07.650 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:07.650 INFO:teuthology.orchestra.run.smithi029.stdout:mon is available 2024-09-21T06:59:07.650 INFO:teuthology.orchestra.run.smithi029.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T06:59:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:59:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: monmap epoch 1 2024-09-21T06:59:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: last_changed 2024-09-21T06:59:02.874698+0000 2024-09-21T06:59:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: created 2024-09-21T06:59:02.874698+0000 2024-09-21T06:59:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: min_mon_release 19 (squid) 2024-09-21T06:59:07.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: election_strategy: 1 2024-09-21T06:59:07.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T06:59:07.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: fsmap 2024-09-21T06:59:07.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:59:07.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: mgrmap e1: no daemons active 2024-09-21T06:59:07.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:07 smithi029 ceph-mon[30617]: from='client.? 172.21.15.29:0/3069819773' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T06:59:08.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:08.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:59:08.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout fsid = d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:08.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:59:08.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2024-09-21T06:59:08.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:59:08.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:59:08.723 INFO:teuthology.orchestra.run.smithi029.stdout:Generating new minimal ceph.conf... 2024-09-21T06:59:08.843 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:08 smithi029 ceph-mon[30617]: from='client.? 172.21.15.29:0/1977862552' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:59:08.843 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:08 smithi029 ceph-mon[30617]: from='client.? 172.21.15.29:0/1977862552' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T06:59:09.794 INFO:teuthology.orchestra.run.smithi029.stdout:Restarting the monitor... 2024-09-21T06:59:09.822 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:09 smithi029 ceph-mon[30617]: from='client.? 172.21.15.29:0/2076948107' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:59:09.822 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:09 smithi029 systemd[1]: Stopping Ceph mon.a for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T06:59:10.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a[30613]: 2024-09-21T06:59:10.085+0000 7f0a644dd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:59:10.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a[30613]: 2024-09-21T06:59:10.085+0000 7f0a644dd640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T06:59:10.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:10 smithi029 podman[30858]: 2024-09-21 06:59:10.239569284 +0000 UTC m=+0.267003944 container died 1b7c54b6638b29970b9b746107a304050e0f09f6175a250ef378882f2b7d7df5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:59:10.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:10 smithi029 podman[30858]: 2024-09-21 06:59:10.770198728 +0000 UTC m=+0.797633379 container cleanup 1b7c54b6638b29970b9b746107a304050e0f09f6175a250ef378882f2b7d7df5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:59:10.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:10 smithi029 bash[30858]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:59:11.224 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:10 smithi029 podman[30870]: 2024-09-21 06:59:10.965416867 +0000 UTC m=+0.727471356 container remove 1b7c54b6638b29970b9b746107a304050e0f09f6175a250ef378882f2b7d7df5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T06:59:11.550 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 systemd[1]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T06:59:11.550 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 systemd[1]: Stopped Ceph mon.a for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:59:11.550 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 systemd[1]: Starting Ceph mon.a for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T06:59:11.550 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 podman[30964]: 2024-09-21 06:59:11.340826228 +0000 UTC m=+0.016241813 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:11.550 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 podman[30964]: 2024-09-21 06:59:11.45054023 +0000 UTC m=+0.125955853 container create c2727873ade09cc7f44c909cecdb4bbe280da7a48377ac255814ff5d3b7506b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:59:11.771 INFO:teuthology.orchestra.run.smithi029.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 podman[30964]: 2024-09-21 06:59:11.662595875 +0000 UTC m=+0.338011449 container init c2727873ade09cc7f44c909cecdb4bbe280da7a48377ac255814ff5d3b7506b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 podman[30964]: 2024-09-21 06:59:11.665994927 +0000 UTC m=+0.341410492 container start c2727873ade09cc7f44c909cecdb4bbe280da7a48377ac255814ff5d3b7506b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: pidfile_write: ignore empty --pid-file 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: load: jerasure load: lrc 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:59:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Git sha 0 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: DB SUMMARY 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: DB Session ID: 8L1EGQZQAIJZRKQ5GG75 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94602 ; 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:59:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.env: 0x56092976bd60 2024-09-21T06:59:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:59:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.info_log: 0x56092e627360 2024-09-21T06:59:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.statistics: (nil) 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.use_fsync: 0 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:59:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.db_log_dir: 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.wal_dir: 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:59:11.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.write_buffer_manager: 0x56092e62bd60 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:59:11.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.unordered_write: 0 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.row_cache: None 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.wal_filter: None 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:59:11.878 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.wal_compression: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:59:11.879 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_open_files: -1 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:59:11.880 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Compression algorithms supported: 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kZSTD supported: 0 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:59:11.881 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.merge_operator: 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_filter: None 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56092e626fa0) 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout: index_type: 0 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout: data_block_index_type: 0 2024-09-21T06:59:11.882 INFO:journalctl@ceph.mon.a.smithi029.stdout: index_shortening: 1 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: checksum: 4 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: no_block_cache: 0 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache: 0x56092a5eb610 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache_options: 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: capacity : 536870912 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: num_shard_bits : 4 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: strict_capacity_limit : 0 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache_compressed: (nil) 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: persistent_cache: (nil) 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_size: 4096 2024-09-21T06:59:11.883 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_size_deviation: 10 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_restart_interval: 16 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: index_block_restart_interval: 1 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: metadata_block_size: 4096 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: partition_filters: 0 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: use_delta_encoding: 1 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: filter_policy: bloomfilter 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: whole_key_filtering: 1 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: verify_compression: 0 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: format_version: 5 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: enable_index_compression: 1 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_align: 0 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: max_auto_readahead_size: 262144 2024-09-21T06:59:11.884 INFO:journalctl@ceph.mon.a.smithi029.stdout: prepopulate_block_cache: 0 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression: NoCompression 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.num_levels: 7 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:59:11.885 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:59:11.886 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:59:11.887 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:59:11.888 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:59:11.889 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.ttl: 2592000 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:59:11.890 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4f6061db-6093-422f-980c-66da54ef63d4 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901951703452, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901951704686, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90828, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 283, "table_properties": {"data_size": 88869, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11567, "raw_average_key_size": 47, "raw_value_size": 82332, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726901951, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4f6061db-6093-422f-980c-66da54ef63d4", "db_session_id": "8L1EGQZQAIJZRKQ5GG75", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726901951704785, "job": 1, "event": "recovery_finished"} 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T06:59:11.891 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56092e64aa80 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: DB pointer 0x56092f3f0000 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** DB Stats ** 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-21T06:59:11.892 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** Compaction Stats [default] ** 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: L0 2/0 90.56 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: Sum 2/0 90.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** Compaction Stats [default] ** 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-21T06:59:11.893 INFO:journalctl@ceph.mon.a.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative compaction: 0.00 GB write, 24.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval compaction: 0.00 GB write, 24.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: Block cache BinnedLRUCache@0x56092a5eb610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: starting mon.a rank 0 at public addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] at bind addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:11.894 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???) e1 preinit fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???).mds e1 new map 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???).mds e1 print_map 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout: e1 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout: btime 2024-09-21T06:59:06:543660+0000 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout: legacy client fscid: -1 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout: No filesystems configured 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:59:11.895 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: monmap epoch 1 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: last_changed 2024-09-21T06:59:02.874698+0000 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: created 2024-09-21T06:59:02.874698+0000 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: election_strategy: 1 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: fsmap 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 ceph-mon[30983]: mgrmap e1: no daemons active 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 bash[30964]: c2727873ade09cc7f44c909cecdb4bbe280da7a48377ac255814ff5d3b7506b8 2024-09-21T06:59:11.896 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:11 smithi029 systemd[1]: Started Ceph mon.a for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:59:12.893 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T06:59:12.914 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:59:12.914 INFO:teuthology.orchestra.run.smithi029.stdout:Creating mgr... 2024-09-21T06:59:12.914 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T06:59:12.915 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T06:59:13.178 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:59:13.178 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to reset failed state of unit ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T06:59:13.336 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490.target.wants/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@.service. 2024-09-21T06:59:13.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:13 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1556511965' entity='client.admin' 2024-09-21T06:59:13.622 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:13 smithi029 podman[31194]: 2024-09-21 06:59:13.584209366 +0000 UTC m=+0.128632455 container create f32a34e381bd36e2af8dfa114bca8170e772ab39002a28a66360add084e61ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:59:13.917 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:59:13.917 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-21T06:59:13.925 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:59:13.925 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-21T06:59:13.925 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-21T06:59:13.925 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:59:13.934 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:59:13.947 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-21T06:59:13.948 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:59:13.948 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-21T06:59:13.948 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-21T06:59:13.948 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T06:59:13.949 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr to start... 2024-09-21T06:59:13.949 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr... 2024-09-21T06:59:14.060 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:13 smithi029 podman[31194]: 2024-09-21 06:59:13.80678396 +0000 UTC m=+0.351207056 container init f32a34e381bd36e2af8dfa114bca8170e772ab39002a28a66360add084e61ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:59:14.073 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:13 smithi029 podman[31194]: 2024-09-21 06:59:13.8096247 +0000 UTC m=+0.354047799 container start f32a34e381bd36e2af8dfa114bca8170e772ab39002a28a66360add084e61ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:59:14.074 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:13 smithi029 bash[31194]: f32a34e381bd36e2af8dfa114bca8170e772ab39002a28a66360add084e61ff3 2024-09-21T06:59:14.074 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:13 smithi029 systemd[1]: Started Ceph mgr.x for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T06:59:14.745 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:14 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2845389435' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:15.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:59:15.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:59:15.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:59:15.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:15.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:59:15.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:15.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:59:06:543660+0000", 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:59:15.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:59:06.544530+0000", 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:59:15.086 INFO:teuthology.orchestra.run.smithi029.stdout:mgr not available, waiting (1/15)... 2024-09-21T06:59:17.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:17 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1555257107' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:59:18.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:18.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:59:18.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T06:59:18.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:59:18.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:59:18.228 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:59:18.229 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:59:18.230 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:59:18.233 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:18.233 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:59:18.233 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:59:18.233 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:59:18.233 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:59:18.233 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:59:06:543660+0000", 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:59:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:59:06.544530+0000", 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:59:18.235 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:59:18.236 INFO:teuthology.orchestra.run.smithi029.stdout:mgr not available, waiting (2/15)... 2024-09-21T06:59:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: Activating manager daemon x 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: mgrmap e2: x(active, starting, since 0.00344666s) 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' 2024-09-21T06:59:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:19 smithi029 ceph-mon[30983]: from='mgr.14100 172.21.15.29:0/2275460040' entity='mgr.x' 2024-09-21T06:59:21.302 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:21 smithi029 ceph-mon[30983]: mgrmap e3: x(active, since 1.00833s) 2024-09-21T06:59:21.302 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:21 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3816902533' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:59:21.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:21.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:59:21.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T06:59:21.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:59:21.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:59:21.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:59:21.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:59:21.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:21.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T06:59:21.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:59:21.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:21.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:59:21.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:59:21.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:21.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:59:21.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:21.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:59:21.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:59:21.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:59:21.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:59:21.637 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:59:21.637 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:59:21.637 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:59:21.638 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:59:06:543660+0000", 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:59:21.639 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:59:06.544530+0000", 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:59:21.640 INFO:teuthology.orchestra.run.smithi029.stdout:mgr is available 2024-09-21T06:59:22.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:22 smithi029 ceph-mon[30983]: mgrmap e4: x(active, since 2s) 2024-09-21T06:59:22.824 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:22.824 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:59:22.824 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout fsid = d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:22.824 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:59:22.825 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:59:22.826 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:59:22.826 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:59:22.826 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling cephadm module... 2024-09-21T06:59:23.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:23 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1845676215' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:59:24.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:24 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3907338093' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T06:59:24.371 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:24 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setuser ceph since I am not root 2024-09-21T06:59:24.371 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:24 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setgroup ceph since I am not root 2024-09-21T06:59:25.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:25 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3907338093' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T06:59:25.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:25 smithi029 ceph-mon[30983]: mgrmap e5: x(active, since 5s) 2024-09-21T06:59:26.113 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:59:26.113 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T06:59:26.113 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:59:26.113 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:59:26.114 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:59:26.114 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:59:26.114 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for the mgr to restart... 2024-09-21T06:59:26.114 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr epoch 5... 2024-09-21T06:59:26.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:26 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/272594068' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:59:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T06:59:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: Activating manager daemon x 2024-09-21T06:59:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T06:59:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: mgrmap e6: x(active, starting, since 0.00401137s) 2024-09-21T06:59:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:59:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:59:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:59:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:59:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:59:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:29 smithi029 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T06:59:31.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:59:31.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T06:59:31.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:59:31.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:59:31.011 INFO:teuthology.orchestra.run.smithi029.stdout:mgr epoch 5 is available 2024-09-21T06:59:31.011 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying orchestrator module is enabled... 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: Found migration_current of "None". Setting to last migration. 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:59:31.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:59:31.310 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: mgrmap e7: x(active, since 1.0065s) 2024-09-21T06:59:31.310 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:31 smithi029 ceph-mon[30983]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:59:32.493 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3871758615' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T06:59:32.817 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:59:32.524+0000 7fee4d998640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:59:32] ENGINE Error in HTTPServer.serve 2024-09-21T06:59:32.817 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: Traceback (most recent call last): 2024-09-21T06:59:32.817 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:59:32.817 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self._connections.run(self.expiration_interval) 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self._run(expiration_interval) 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: s = self.context.wrap_socket( 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: return self.sslsocket_class._create( 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self.do_handshake() 2024-09-21T06:59:32.818 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:59:32.819 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self._sslobj.do_handshake() 2024-09-21T06:59:32.819 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:59:32.819 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:59:32.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T06:59:32.819 INFO:teuthology.orchestra.run.smithi029.stdout:Setting orchestrator backend to cephadm... 2024-09-21T06:59:33.479 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3871758615' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T06:59:33.479 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: mgrmap e8: x(active, since 2s) 2024-09-21T06:59:33.479 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:32] ENGINE Bus STARTING 2024-09-21T06:59:33.479 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:32] ENGINE Serving on http://172.21.15.29:8765 2024-09-21T06:59:33.479 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:32] ENGINE Serving on https://172.21.15.29:7150 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:32] ENGINE Bus STARTED 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:33 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:32] ENGINE Error in HTTPServer.serve 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: Traceback (most recent call last): 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._run(expiration_interval) 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: s = self.context.wrap_socket( 2024-09-21T06:59:33.480 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:59:33.481 INFO:journalctl@ceph.mon.a.smithi029.stdout: return self.sslsocket_class._create( 2024-09-21T06:59:33.481 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:59:33.481 INFO:journalctl@ceph.mon.a.smithi029.stdout: self.do_handshake() 2024-09-21T06:59:33.481 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:59:33.481 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._sslobj.do_handshake() 2024-09-21T06:59:33.481 INFO:journalctl@ceph.mon.a.smithi029.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:59:34.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:34 smithi029 ceph-mon[30983]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:34.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:34 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:34.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:34 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:35.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T06:59:35.307 INFO:teuthology.orchestra.run.smithi029.stdout:Generating ssh key... 2024-09-21T06:59:35.744 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:35 smithi029 ceph-mon[30983]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:36.616 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-mon[30983]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:36.616 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-mon[30983]: Generating ssh key... 2024-09-21T06:59:36.616 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:36.616 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: Generating public/private rsa key pair. 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: Your identification has been saved in /tmp/tmphkjd0f7y/key 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: Your public key has been saved in /tmp/tmphkjd0f7y/key.pub 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: The key fingerprint is: 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: SHA256:OPo4rO7SQgu1mPu7eIwNx1o9Kr7K8guZx6FhsR2iQdQ ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: The key's randomart image is: 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: +---[RSA 3072]----+ 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |.o. | 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |. E | 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |.o . | 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |..* . . | 2024-09-21T06:59:36.617 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |oB.+ o S | 2024-09-21T06:59:36.618 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |*B=.o. . | 2024-09-21T06:59:36.618 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |B@+o.. | 2024-09-21T06:59:36.618 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |X=* oo | 2024-09-21T06:59:36.618 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: |*&@=... | 2024-09-21T06:59:36.618 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: +----[SHA256]-----+ 2024-09-21T06:59:38.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkTPf+r37pwtNxXdwALDfspw7RUOXQGIzFHcAmgKGp8Pd6qiQBTXRyj5RcwEfLnblNNw4qLR7cV+pfd64MQSdI7e/l1/deKChjWIzQbymvAfMIWflL1yPv4/BQp0LQXe3u5aL6q4pIY2Z0Ypi3jGb7CgLYiyYo5uyBU7dQdBCdwJAbvSIA4/zUQzAGjW0r2hlx85z2+aaZF+4fE1YUVn8Sa277fGcxW1lyRy9PgsI1bq3/s2Gy0RJ2Ln1Lc2tO4YQ8lmG/3cghQvjzK+hgfLPfDLTmY7/dNCNU28Q2N+MecZzqy/ZFY3sNQR+JAWzQoiT9TKBw9oWDjszfV9FJan71wBbJEVGLHds4mSdFpzQr/fQ8uW7G4Qrk4p1XjvCiskVZSpgKZRUaW1Ow43pCJQeqsQnF1EsU8ObsEsXcxifLdoQTRguxA5f1vde3dwzQlbAnuIsQKap4jYiX36XADK3r6ikGrTDRh4JVgm+JX3C7aAOAZ453ikaQddXkLuOk+x0= ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T06:59:38.220 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:59:38.221 INFO:teuthology.orchestra.run.smithi029.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T06:59:38.226 INFO:teuthology.orchestra.run.smithi029.stdout:Adding host smithi029... 2024-09-21T06:59:38.469 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:38 smithi029 ceph-mon[30983]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:39.303 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:39 smithi029 ceph-mon[30983]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi029", "addr": "172.21.15.29", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:40.444 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:40 smithi029 ceph-mon[30983]: Deploying cephadm binary to smithi029 2024-09-21T06:59:43.357 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Added host 'smithi029' with addr '172.21.15.29' 2024-09-21T06:59:43.357 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying unmanaged mon service... 2024-09-21T06:59:43.974 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:43 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:43.975 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:43 smithi029 ceph-mon[30983]: Added host smithi029 2024-09-21T06:59:43.975 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:43 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:44.757 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T06:59:44.855 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying unmanaged mgr service... 2024-09-21T06:59:45.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:45 smithi029 ceph-mon[30983]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:45.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:45 smithi029 ceph-mon[30983]: Saving service mon spec with placement count:5 2024-09-21T06:59:45.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:45 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:46.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:46 smithi029 ceph-mon[30983]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:59:46.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:46 smithi029 ceph-mon[30983]: Saving service mgr spec with placement count:2 2024-09-21T06:59:46.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:46 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:46.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:46 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:46.665 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T06:59:48.576 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:48 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:48.576 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:48 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/90574490' entity='client.admin' 2024-09-21T06:59:49.766 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:49 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3268987384' entity='client.admin' 2024-09-21T06:59:49.766 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:49 smithi029 ceph-mon[30983]: from='mgr.14118 172.21.15.29:0/320963738' entity='mgr.x' 2024-09-21T06:59:49.768 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling the dashboard module... 2024-09-21T06:59:50.656 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:50 smithi029 ceph-mon[30983]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:59:50.657 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:50 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2738045752' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T06:59:50.945 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:50 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setuser ceph since I am not root 2024-09-21T06:59:50.946 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:50 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setgroup ceph since I am not root 2024-09-21T06:59:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:51 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2738045752' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T06:59:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:51 smithi029 ceph-mon[30983]: mgrmap e9: x(active, since 21s) 2024-09-21T06:59:52.533 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:59:52.533 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T06:59:52.533 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:59:52.534 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:59:52.534 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:59:52.534 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:59:52.534 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for the mgr to restart... 2024-09-21T06:59:52.534 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr epoch 9... 2024-09-21T06:59:52.655 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:52 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2747156546' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:59:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T06:59:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: Activating manager daemon x 2024-09-21T06:59:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T06:59:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: mgrmap e10: x(active, starting, since 0.00421783s) 2024-09-21T06:59:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:59:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:59:56.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:59:56.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:59:56.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:59:56.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:55 smithi029 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T06:59:57.309 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:59:57.310 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:59:57.310 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:59:57.310 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:56 smithi029 ceph-mon[30983]: mgrmap e11: x(active, since 1.00697s) 2024-09-21T06:59:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:57 smithi029 ceph-mon[30983]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:59:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:57 smithi029 ceph-mon[30983]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:59:58.099+0000 7f3479568640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:59:58] ENGINE Error in HTTPServer.serve 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: Traceback (most recent call last): 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self._connections.run(self.expiration_interval) 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self._run(expiration_interval) 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:59:58.122 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: s = self.context.wrap_socket( 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: return self.sslsocket_class._create( 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self.do_handshake() 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: self._sslobj.do_handshake() 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:59:58.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:59:58.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:59:58.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T06:59:58.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:59:58.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:59:58.224 INFO:teuthology.orchestra.run.smithi029.stdout:mgr epoch 9 is available 2024-09-21T06:59:58.224 INFO:teuthology.orchestra.run.smithi029.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T06:59:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:57] ENGINE Bus STARTING 2024-09-21T06:59:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-mon[30983]: mgrmap e12: x(active, since 2s) 2024-09-21T06:59:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:57] ENGINE Serving on http://172.21.15.29:8765 2024-09-21T06:59:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:58] ENGINE Serving on https://172.21.15.29:7150 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:58] ENGINE Bus STARTED 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-mon[30983]: [21/Sep/2024:06:59:58] ENGINE Error in HTTPServer.serve 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: Traceback (most recent call last): 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._run(expiration_interval) 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: s = self.context.wrap_socket( 2024-09-21T06:59:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:59:59.373 INFO:journalctl@ceph.mon.a.smithi029.stdout: return self.sslsocket_class._create( 2024-09-21T06:59:59.373 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:59:59.373 INFO:journalctl@ceph.mon.a.smithi029.stdout: self.do_handshake() 2024-09-21T06:59:59.373 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:59:59.373 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._sslobj.do_handshake() 2024-09-21T06:59:59.373 INFO:journalctl@ceph.mon.a.smithi029.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:59:59.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 06:59:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:00.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:00 smithi029 ceph-mon[30983]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:00.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:01.071 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUewbH3lmruV6LAV5s23zLqehkTJAwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA2NTk1OVoXDTM0\nMDkyMjA2NTk1OVowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjI5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA8slRX3htmaZ8zg8d8hcWcpkqqN4JJ4LHNzeG\nJJlKo4yc2Cxk4KDTT4fj7qrM+6Un65e+1Lk9GRIi9pt2L4j2zsyxt4u3fBjEsjPp\nsdSxpaT23Ln0OoE5Qxh2ZFosIEa1OYPd7EiIXgmX/kYxO/yBxs9lGC37vFcQQ3zR\n6M0TCcVFmkIWE20Y2+iEoFeaKfcbrjxjg6piwTvuf5U4xoMJ9bQ2Vk7H0sIgSPNZ\nl0x3YxI/7uPt+ZFzWipqTn/DyXxFW/X2JfsjlmgDETJhNj1CkLolrXiGKueCOmlv\nBRf9vL2LdQiqJrYMkwClfc/qit9gA7QRYvl4acL+FFwJSnivkXGrkDQ5vqg8FTE4\nuldKfirAwD+yQNmoNZlMTBctxdbtJhI2iheS10clZ5pYaxhOiIXwMF3w86YQE/lS\nDOV04JlK3YYO8maW/bQgwiFPNc+65xO+nV4z3u4zFu7s1t7gi0HjS2KxCcBNq+2b\nMC+XdOcg8HN/ywQce+dd+d5bj6qZ14HyAEhrDjLiZ7Dbwr/Xmci62b4bldaCEqne\nzvx8eVPuEE9e3hCtAm9F/Jv4339JMnT42btczuf2SZ9PWEYPgCVVJQxzrZe06oO1\n7x7uJAllVzslkvjdN/0QYuCESfc06DoKzTce8DCBVlxBOZil+5z8IRdJkHT9VRI7\n/TJ25KcCAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDI5LmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPHTAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQBxav6ip8jvYCjg7XxGe+rgY4FIgNffjREiXxMv\njyy3KsdbRwAlYFOI0tKQN+NqDgoxS7BZVqznlSsMjPiu6lqkOlI/cBPUS52pyeE3\nw9ZqVy7TA//K0b/3lI5yqA97oQzYbKWnZ/A/+GRVdxaU1Bbrb07IyxAXdN0ra45x\n858+bxlRuILk+GwBeGvjCjjLJfoVUWKjwFmnrcUX538NxNlq6ZsZGRGpBug+ODYy\n1xWgRtLp/23NSA3kEVdkVBIdxhEK4l+8ULkbXwX3bjn7fj9R7gfzZ/nXgvkcnnWZ\nL7L8Q/egxQh9n3aohbhhmwhfP/ISmG4Pt+OqWXYYhTohr3kZhWLxhWpCxpoj9PNB\n8eO+UasuLDdgEv0QN5arhd/CzypUska0BgJA6w2hr5RV2U6K2OZ8hrW1HbUAtR8o\nC1TuiS4Y3U/bb0ovSTQcPlR5fxZZlNCHNmKXqSVFoCXMys7swhrkMLpLQZUmGqCa\nEZiNFGNd0ZcVVY0StiBE2pwDkPesxDRt/N00xzzdSzpD39C7IO+jyp8N72a1Jog0\npcZO04K57OHTY8w2l+xfLB5CrSGn4vT0Hdl9Hl/Dy3m3hXFeSqq7uQQ5jrBRPo/m\nvCd4PhGc+RhWb3tGY/PFX4SWZgtSUwDc5JSMowMW4difkfIk9SUYUt9YS/1dkvH3\nGfX74w==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEA8slRX3htmaZ8zg8d8hcWcpkqqN4JJ4LHNzeGJJlKo4yc2Cxk\n4KDTT4fj7qrM+6Un65e+1Lk9GRIi9pt2L4j2zsyxt4u3fBjEsjPpsdSxpaT23Ln0\nOoE5Qxh2ZFosIEa1OYPd7EiIXgmX/kYxO/yBxs9lGC37vFcQQ3zR6M0TCcVFmkIW\nE20Y2+iEoFeaKfcbrjxjg6piwTvuf5U4xoMJ9bQ2Vk7H0sIgSPNZl0x3YxI/7uPt\n+ZFzWipqTn/DyXxFW/X2JfsjlmgDETJhNj1CkLolrXiGKueCOmlvBRf9vL2LdQiq\nJrYMkwClfc/qit9gA7QRYvl4acL+FFwJSnivkXGrkDQ5vqg8FTE4uldKfirAwD+y\nQNmoNZlMTBctxdbtJhI2iheS10clZ5pYaxhOiIXwMF3w86YQE/lSDOV04JlK3YYO\n8maW/bQgwiFPNc+65xO+nV4z3u4zFu7s1t7gi0HjS2KxCcBNq+2bMC+XdOcg8HN/\nywQce+dd+d5bj6qZ14HyAEhrDjLiZ7Dbwr/Xmci62b4bldaCEqnezvx8eVPuEE9e\n3hCtAm9F/Jv4339JMnT42btczuf2SZ9PWEYPgCVVJQxzrZe06oO17x7uJAllVzsl\nkvjdN/0QYuCESfc06DoKzTce8DCBVlxBOZil+5z8IRdJkHT9VRI7/TJ25KcCAwEA\nAQKCAgAhS3l00cOaBCpuacVOC1uBOL8QbG6t8/HVATDMuRbyydhCjwgAhB2mdPjN\npK+6vOH2HZfGfWbDFukjj5tMFojeQFUI2ki95HmpBJSCVixMjoxqJbg4A7uyF1s5\nFOKjRH8a1ZosCqBk4QTuknqzAsRbWtq+z6OLpxbsYmQ4/FKljt+mMXTskhQMKF1z\nzb+vDJvHr7Fn/4hOfqUM6w5frt3BS8b93AzsOsIJrxG0vYBL3ldVL/3VMVyz20g7\n3qqfaYLrgxYQDFpLiJUPGS0arpj/1v9OxE4F+TyzPP1EIg+igA3tbVREPcgIqtiH\nIenExLBaoamWvKaGPn7wlNSTWWyeDasM3esWav3JRwad3JaqzXmc4HSULkTT8FAw\ncJx9ZcteHpBtcLaByQFIOecOpPbWnDjzldDTm1QKPSwGNW79qxMYAOEUahAlKWCw\nP1XjrF/4q8bJkpY1RkpwKCb1NMrnw8/l8bpYiHeFOR0LYbVqINpDz1BbpXCi2Pw4\nCmx7JcEd4ELXx3bUZ/JWkR2VZZXjqg6uyz1wCYhjDtr+jTKBWCGKEMuZUiQZAmLo\nI+MVMhEdnPqjjNB6oizuIxQh0ZP/xYNUv/kx6PD4dRM49qdmYd1PVg1h5Xb5aVzf\nBlD7l5usZV2HwO+h8+buLWuNLdndpVb/HtUSQ4jXJy6J/dpt0QKCAQEA+irMMtkl\nUgR0N5APF7nIcWx1Rj22kP0vSsGxFzoCQ22+MK9ehROktBW/1UIOzfTbne3Z2l6B\nRmDE7jdQPyD7MZ1seL2VQXEZ5RnoJcBNtM75wbT43M8sDvStgDRAyvmYo8QMcCZF\nhpTrmdVnx3s+8pMbE7mtd053hPc2rGWskB9XRG6oHaPY7KuuOouMVi6EKT3HDiIG\n6CuKG3636HD8fYM6/fQx1inHFIe00bqFdtvhhZG8VUSIg+0JLO0FYC9J0uhytrrt\nYZTSSXrrCITuIdXwJU3Vqad7z2aPdLHx3O5cVANhzUzy8kXcbRV09FRr+/LjZBNn\nPUR9GUiB9pRONwKCAQEA+HJ3NqEl/RIfOMEDAG39r0qDSQ4X9BIArVxs+bAOpuNC\nSLXBc3qyd6EPQuD+kC3oWcXCCJD/DUbBnT+VmW7ac3ZhOtyDm9MuH3D+WyWLSFIr\nR8U2zYmPm9+BL4MDCUKbjNPeskYc1I8owpFYC1f16mcMQrOAlJZLUgHJM4MjJJx+\nLb2tsiGMf6i3kb04ccx7o9Y0JOF+5TYH1Hy7xHHX/yrAvjiNRhuhmSd09RAbBaQV\n9NJigJkuSfUMNPcDZKKFJq86Tw7Y2KFJZ19f7GpKu6ksy/aW0VB04zZegNQR7gD9\nCTHQi/nQIz8/iDWBv/1R12TN0draUF86RSeS3U5lEQKCAQB+pY/+5gOIxAx53Ipn\nfnxFP50XVELKoAKDHA+lLI7cyAAS8ZUuVcV6DdCyC+EmzyEnkLRLYrCbin3oA0Sy\n0OWaNpIlhgS7vqBXZYgrJHGyaV3zfMTINHGfmKsFTm7G0xk9PxD07csg2N91X55M\nVM6HS4XXtJZm4eiL/gNFv6tewx8Q29xsNPiqyDdKGD+Rmbb6kfXl58ALZY9jYAGG\nwTxx5i/FRQy92SSZ9iHKU10h0SsYzbDEkg9yiluszMl96jK7fUYlz/hBAHB9FqdK\nBtHvezk6CW9zlgCN/OP/Nd619E31kki/AIe1szxmVQiCcQLB6DLKBTCsybFzTUvO\nI0J9AoIBACr+O+0DM/y4PxjmJavUXNsRrOhefPyqhN17KgyHT/HHT/gfI8vlBq82\n+toa71Jp71RhqXMsDEby4JxinXPAwCLM8IRsFoZHpCqithF1zMWGGqE/2nz0+hoC\nMmvTYxoeIabcHySAh4qs/2O0HSVRYmfezztXrr+Hxp75WiUE43b5cchek4lIzvRk\ncOfSc8sVlKvEbJ+ZOglWMUKvFxsmjDdG4bXJOYFRVMSZFF84G0T9oSMNqSgR2fXI\nZwVfXYHzsdEA77kwm4vZVUeDNKlHt4kD/JGLKYwtPRz4kp/+kt+54g/ORAWFBGSl\nFExw3fQoVRpOAmP3WGIiKIZBE+QiJdECggEBAKBfG4hjiAqfJHflpmvwaBpY2L1U\ngIsNkgrxF8pfXETBdlwPc6zDDBZJJokbttZIjvAJfLzbx7HOepSvNY99STDEbplU\nYpYikGXhbur+btMFk7lju3TG758LM0GIoyCi6JKgtwJMB7vJRTSWaxXLVKCpVC+G\nEWExN8FF+LgSu8+w7YEl9Ewzxr0EFh8gn0SaIPz9A0blqKEPdkjRgO5XFU2mWE/P\n+My6JNUXOqsh13J0hP6AqbgL0VrOZcZHxcwVWctDyEk804afluf9dxsEGyTmy/SD\ndVdfqz60zQvK+oyN9sNAXFpjYt/VSjJGm0/VcGZrxyPwtqgqa7vWKW1Y+4I=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T07:00:02.494 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T07:00:03.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:02 smithi029 ceph-mon[30983]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:03.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:03.769 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T07:00:03.769 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial admin user... 2024-09-21T07:00:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:04 smithi029 ceph-mon[30983]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:05.363 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:05 smithi029 ceph-mon[30983]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:05.363 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:05 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:05.365 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Z3won9C9M0FP3Wkow2397.Mg063CwFTv78ckXWXPLibZXyq/6HvUS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726902004, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T07:00:05.365 INFO:teuthology.orchestra.run.smithi029.stdout:Fetching dashboard port number... 2024-09-21T07:00:06.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:06 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2364308341' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T07:00:06.672 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T07:00:06.682 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T07:00:06.682 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-21T07:00:06.689 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T07:00:06.690 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-21T07:00:06.690 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-21T07:00:06.690 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T07:00:06.692 INFO:teuthology.orchestra.run.smithi029.stdout:Ceph Dashboard is now available at: 2024-09-21T07:00:06.692 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:06.692 INFO:teuthology.orchestra.run.smithi029.stdout: URL: https://smithi029.front.sepia.ceph.com:8443/ 2024-09-21T07:00:06.692 INFO:teuthology.orchestra.run.smithi029.stdout: User: admin 2024-09-21T07:00:06.692 INFO:teuthology.orchestra.run.smithi029.stdout: Password: rjxp3kjokd 2024-09-21T07:00:06.692 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:06.692 INFO:teuthology.orchestra.run.smithi029.stdout:Saving cluster configuration to /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config directory 2024-09-21T07:00:08.146 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.147 INFO:teuthology.orchestra.run.smithi029.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: ceph telemetry on 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout:For more information see: 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:08.148 INFO:teuthology.orchestra.run.smithi029.stdout:Bootstrap complete. 2024-09-21T07:00:08.198 INFO:tasks.cephadm:Fetching config... 2024-09-21T07:00:08.199 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:00:08.199 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T07:00:08.217 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T07:00:08.217 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:00:08.217 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T07:00:08.273 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T07:00:08.273 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:00:08.273 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T07:00:08.341 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T07:00:08.341 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:00:08.341 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T07:00:08.398 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T07:00:08.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkTPf+r37pwtNxXdwALDfspw7RUOXQGIzFHcAmgKGp8Pd6qiQBTXRyj5RcwEfLnblNNw4qLR7cV+pfd64MQSdI7e/l1/deKChjWIzQbymvAfMIWflL1yPv4/BQp0LQXe3u5aL6q4pIY2Z0Ypi3jGb7CgLYiyYo5uyBU7dQdBCdwJAbvSIA4/zUQzAGjW0r2hlx85z2+aaZF+4fE1YUVn8Sa277fGcxW1lyRy9PgsI1bq3/s2Gy0RJ2Ln1Lc2tO4YQ8lmG/3cghQvjzK+hgfLPfDLTmY7/dNCNU28Q2N+MecZzqy/ZFY3sNQR+JAWzQoiT9TKBw9oWDjszfV9FJan71wBbJEVGLHds4mSdFpzQr/fQ8uW7G4Qrk4p1XjvCiskVZSpgKZRUaW1Ow43pCJQeqsQnF1EsU8ObsEsXcxifLdoQTRguxA5f1vde3dwzQlbAnuIsQKap4jYiX36XADK3r6ikGrTDRh4JVgm+JX3C7aAOAZ453ikaQddXkLuOk+x0= ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:00:08.482 INFO:teuthology.orchestra.run.smithi029.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkTPf+r37pwtNxXdwALDfspw7RUOXQGIzFHcAmgKGp8Pd6qiQBTXRyj5RcwEfLnblNNw4qLR7cV+pfd64MQSdI7e/l1/deKChjWIzQbymvAfMIWflL1yPv4/BQp0LQXe3u5aL6q4pIY2Z0Ypi3jGb7CgLYiyYo5uyBU7dQdBCdwJAbvSIA4/zUQzAGjW0r2hlx85z2+aaZF+4fE1YUVn8Sa277fGcxW1lyRy9PgsI1bq3/s2Gy0RJ2Ln1Lc2tO4YQ8lmG/3cghQvjzK+hgfLPfDLTmY7/dNCNU28Q2N+MecZzqy/ZFY3sNQR+JAWzQoiT9TKBw9oWDjszfV9FJan71wBbJEVGLHds4mSdFpzQr/fQ8uW7G4Qrk4p1XjvCiskVZSpgKZRUaW1Ow43pCJQeqsQnF1EsU8ObsEsXcxifLdoQTRguxA5f1vde3dwzQlbAnuIsQKap4jYiX36XADK3r6ikGrTDRh4JVgm+JX3C7aAOAZ453ikaQddXkLuOk+x0= ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:08.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkTPf+r37pwtNxXdwALDfspw7RUOXQGIzFHcAmgKGp8Pd6qiQBTXRyj5RcwEfLnblNNw4qLR7cV+pfd64MQSdI7e/l1/deKChjWIzQbymvAfMIWflL1yPv4/BQp0LQXe3u5aL6q4pIY2Z0Ypi3jGb7CgLYiyYo5uyBU7dQdBCdwJAbvSIA4/zUQzAGjW0r2hlx85z2+aaZF+4fE1YUVn8Sa277fGcxW1lyRy9PgsI1bq3/s2Gy0RJ2Ln1Lc2tO4YQ8lmG/3cghQvjzK+hgfLPfDLTmY7/dNCNU28Q2N+MecZzqy/ZFY3sNQR+JAWzQoiT9TKBw9oWDjszfV9FJan71wBbJEVGLHds4mSdFpzQr/fQ8uW7G4Qrk4p1XjvCiskVZSpgKZRUaW1Ow43pCJQeqsQnF1EsU8ObsEsXcxifLdoQTRguxA5f1vde3dwzQlbAnuIsQKap4jYiX36XADK3r6ikGrTDRh4JVgm+JX3C7aAOAZ453ikaQddXkLuOk+x0= ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:00:08.536 INFO:teuthology.orchestra.run.smithi052.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkTPf+r37pwtNxXdwALDfspw7RUOXQGIzFHcAmgKGp8Pd6qiQBTXRyj5RcwEfLnblNNw4qLR7cV+pfd64MQSdI7e/l1/deKChjWIzQbymvAfMIWflL1yPv4/BQp0LQXe3u5aL6q4pIY2Z0Ypi3jGb7CgLYiyYo5uyBU7dQdBCdwJAbvSIA4/zUQzAGjW0r2hlx85z2+aaZF+4fE1YUVn8Sa277fGcxW1lyRy9PgsI1bq3/s2Gy0RJ2Ln1Lc2tO4YQ8lmG/3cghQvjzK+hgfLPfDLTmY7/dNCNU28Q2N+MecZzqy/ZFY3sNQR+JAWzQoiT9TKBw9oWDjszfV9FJan71wBbJEVGLHds4mSdFpzQr/fQ8uW7G4Qrk4p1XjvCiskVZSpgKZRUaW1Ow43pCJQeqsQnF1EsU8ObsEsXcxifLdoQTRguxA5f1vde3dwzQlbAnuIsQKap4jYiX36XADK3r6ikGrTDRh4JVgm+JX3C7aAOAZ453ikaQddXkLuOk+x0= ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:08.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkTPf+r37pwtNxXdwALDfspw7RUOXQGIzFHcAmgKGp8Pd6qiQBTXRyj5RcwEfLnblNNw4qLR7cV+pfd64MQSdI7e/l1/deKChjWIzQbymvAfMIWflL1yPv4/BQp0LQXe3u5aL6q4pIY2Z0Ypi3jGb7CgLYiyYo5uyBU7dQdBCdwJAbvSIA4/zUQzAGjW0r2hlx85z2+aaZF+4fE1YUVn8Sa277fGcxW1lyRy9PgsI1bq3/s2Gy0RJ2Ln1Lc2tO4YQ8lmG/3cghQvjzK+hgfLPfDLTmY7/dNCNU28Q2N+MecZzqy/ZFY3sNQR+JAWzQoiT9TKBw9oWDjszfV9FJan71wBbJEVGLHds4mSdFpzQr/fQ8uW7G4Qrk4p1XjvCiskVZSpgKZRUaW1Ow43pCJQeqsQnF1EsU8ObsEsXcxifLdoQTRguxA5f1vde3dwzQlbAnuIsQKap4jYiX36XADK3r6ikGrTDRh4JVgm+JX3C7aAOAZ453ikaQddXkLuOk+x0= ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T07:00:08.593 INFO:teuthology.orchestra.run.smithi066.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkTPf+r37pwtNxXdwALDfspw7RUOXQGIzFHcAmgKGp8Pd6qiQBTXRyj5RcwEfLnblNNw4qLR7cV+pfd64MQSdI7e/l1/deKChjWIzQbymvAfMIWflL1yPv4/BQp0LQXe3u5aL6q4pIY2Z0Ypi3jGb7CgLYiyYo5uyBU7dQdBCdwJAbvSIA4/zUQzAGjW0r2hlx85z2+aaZF+4fE1YUVn8Sa277fGcxW1lyRy9PgsI1bq3/s2Gy0RJ2Ln1Lc2tO4YQ8lmG/3cghQvjzK+hgfLPfDLTmY7/dNCNU28Q2N+MecZzqy/ZFY3sNQR+JAWzQoiT9TKBw9oWDjszfV9FJan71wBbJEVGLHds4mSdFpzQr/fQ8uW7G4Qrk4p1XjvCiskVZSpgKZRUaW1Ow43pCJQeqsQnF1EsU8ObsEsXcxifLdoQTRguxA5f1vde3dwzQlbAnuIsQKap4jYiX36XADK3r6ikGrTDRh4JVgm+JX3C7aAOAZ453ikaQddXkLuOk+x0= ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:08.607 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T07:00:08.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:08 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2515645401' entity='client.admin' 2024-09-21T07:00:08.862 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:09.860 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:09 smithi029 ceph-mon[30983]: mgrmap e13: x(active, since 12s) 2024-09-21T07:00:10.175 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T07:00:10.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T07:00:10.761 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:10.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:10 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3004741629' entity='client.admin' 2024-09-21T07:00:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi029", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:11.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:12.253 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi052 2024-09-21T07:00:12.253 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T07:00:12.253 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:00:12.272 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T07:00:12.272 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:12.330 INFO:tasks.cephadm:Adding host smithi052 to orchestrator... 2024-09-21T07:00:12.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch host add smithi052 2024-09-21T07:00:12.581 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:12.965 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:12 smithi029 ceph-mon[30983]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:12.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:12 smithi029 ceph-mon[30983]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-21T07:00:12.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:12 smithi029 ceph-mon[30983]: Updating smithi029:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:12.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:12.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:12.966 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:14.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:13 smithi029 ceph-mon[30983]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:14.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:13 smithi029 ceph-mon[30983]: Updating smithi029:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:00:15.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:14 smithi029 ceph-mon[30983]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi052", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:16.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:15 smithi029 ceph-mon[30983]: Deploying cephadm binary to smithi052 2024-09-21T07:00:17.093 INFO:teuthology.orchestra.run.smithi029.stdout:Added host 'smithi052' with addr '172.21.15.52' 2024-09-21T07:00:17.758 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:17 smithi029 ceph-mon[30983]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:17.758 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:17.758 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:17.758 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:17.758 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:17.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:00:18.045 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:18.726 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:18.727 INFO:teuthology.orchestra.run.smithi029.stdout:[{"addr": "172.21.15.29", "hostname": "smithi029", "labels": [], "status": ""}, {"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}] 2024-09-21T07:00:18.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:18 smithi029 ceph-mon[30983]: Added host smithi052 2024-09-21T07:00:18.727 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:19.468 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi066 2024-09-21T07:00:19.468 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T07:00:19.468 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.conf 2024-09-21T07:00:19.489 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T07:00:19.489 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:19.548 INFO:tasks.cephadm:Adding host smithi066 to orchestrator... 2024-09-21T07:00:19.548 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch host add smithi066 2024-09-21T07:00:19.797 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:19 smithi029 ceph-mon[30983]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:19 smithi029 ceph-mon[30983]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:00:21.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:20 smithi029 ceph-mon[30983]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:21.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:20 smithi029 ceph-mon[30983]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: Updating smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: Deploying cephadm binary to smithi066 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: Updating smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:22.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:23 smithi029 ceph-mon[30983]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:24.221 INFO:teuthology.orchestra.run.smithi029.stdout:Added host 'smithi066' with addr '172.21.15.66' 2024-09-21T07:00:24.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T07:00:25.141 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:25.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:25 smithi029 ceph-mon[30983]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:25.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:25.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:25 smithi029 ceph-mon[30983]: Added host smithi066 2024-09-21T07:00:25.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:25.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:25.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:25.813 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:00:25.814 INFO:teuthology.orchestra.run.smithi029.stdout:[{"addr": "172.21.15.29", "hostname": "smithi029", "labels": [], "status": ""}, {"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}, {"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}] 2024-09-21T07:00:26.467 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T07:00:26.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T07:00:26.717 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:26.839 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:27.552 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-09-21T07:00:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:27 smithi029 ceph-mon[30983]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:00:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:27 smithi029 ceph-mon[30983]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:27 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2449468319' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:00:28.217 INFO:tasks.cephadm:Adding mon.a on smithi029 2024-09-21T07:00:28.217 INFO:tasks.cephadm:Adding mon.b on smithi052 2024-09-21T07:00:28.217 INFO:tasks.cephadm:Adding mon.c on smithi066 2024-09-21T07:00:28.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi029:172.21.15.29=a;smithi052:172.21.15.52=b;smithi066:172.21.15.66=c' 2024-09-21T07:00:28.532 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T07:00:28.578 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:28.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2449468319' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:00:28.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:00:28.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:28.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:28.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:28.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:28.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:28.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:28.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:29.262 INFO:teuthology.orchestra.run.smithi066.stdout:Scheduled mon update... 2024-09-21T07:00:29.838 DEBUG:teuthology.orchestra.run.smithi052:mon.b> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T07:00:29.841 DEBUG:teuthology.orchestra.run.smithi066:mon.c> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T07:00:29.843 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:00:29.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:00:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-21T07:00:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: Updating smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:30.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:30 smithi029 ceph-mon[30983]: Updating smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:00:30.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:30 smithi029 ceph-mon[30983]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi029:172.21.15.29=a;smithi052:172.21.15.52=b;smithi066:172.21.15.66=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:30.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:30 smithi029 ceph-mon[30983]: Saving service mon spec with placement smithi029:172.21.15.29=a;smithi052:172.21.15.52=b;smithi066:172.21.15.66=c;count:3 2024-09-21T07:00:30.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:30 smithi029 ceph-mon[30983]: Deploying daemon mon.c on smithi066 2024-09-21T07:00:31.619 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:31.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:31 smithi029 ceph-mon[30983]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:32.921 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:00:32.922 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":1,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","modified":"2024-09-21T06:59:02.874698Z","created":"2024-09-21T06:59:02.874698Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T07:00:32.922 INFO:teuthology.orchestra.run.smithi066.stderr:dumped monmap epoch 1 2024-09-21T07:00:33.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 systemd[1]: Starting Ceph mon.c for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:00:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:33 smithi029 ceph-mon[30983]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:33 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/1463182249' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:33.963 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 podman[34774]: 2024-09-21 07:00:33.751553322 +0000 UTC m=+0.109921142 container create ab75bd0e71fc1484b77a913ce290cc2c9834493810e2ac9dff16a0875dc3230a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T07:00:33.963 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 podman[34774]: 2024-09-21 07:00:33.659386829 +0000 UTC m=+0.017754651 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:00:33.963 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 podman[34774]: 2024-09-21 07:00:33.962050001 +0000 UTC m=+0.320417839 container init ab75bd0e71fc1484b77a913ce290cc2c9834493810e2ac9dff16a0875dc3230a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 podman[34774]: 2024-09-21 07:00:33.965321149 +0000 UTC m=+0.323688969 container start ab75bd0e71fc1484b77a913ce290cc2c9834493810e2ac9dff16a0875dc3230a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 ceph-mon[34793]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 ceph-mon[34793]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:33 smithi066 ceph-mon[34793]: pidfile_write: ignore empty --pid-file 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: load: jerasure load: lrc 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: RocksDB version: 7.9.2 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Git sha 0 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: DB SUMMARY 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: DB Session ID: NF30AOTO4Z5EO9EPHNK5 2024-09-21T07:00:34.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: CURRENT file: CURRENT 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.error_if_exists: 0 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.create_if_missing: 0 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.paranoid_checks: 1 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.env: 0x5638ab3d9d60 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.info_log: 0x5638b1605360 2024-09-21T07:00:34.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.statistics: (nil) 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.use_fsync: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_log_file_size: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.allow_fallocate: 1 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.use_direct_reads: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T07:00:34.354 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.db_log_dir: 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.wal_dir: 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.write_buffer_manager: 0x5638b1609d60 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T07:00:34.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.unordered_write: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.row_cache: None 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.wal_filter: None 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.two_write_queues: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T07:00:34.356 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.wal_compression: 0 2024-09-21T07:00:34.357 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.atomic_flush: 0 2024-09-21T07:00:34.357 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T07:00:34.357 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T07:00:34.358 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T07:00:34.358 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.log_readahead_size: 0 2024-09-21T07:00:34.358 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T07:00:34.358 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T07:00:34.358 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T07:00:34.358 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_background_jobs: 2 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_background_compactions: -1 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_subcompactions: 1 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T07:00:34.359 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_open_files: -1 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_background_flushes: -1 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Compression algorithms supported: 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kZSTD supported: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kXpressCompression supported: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kBZip2Compression supported: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kLZ4Compression supported: 1 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kZlibCompression supported: 1 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: kSnappyCompression supported: 1 2024-09-21T07:00:34.360 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.merge_operator: 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_filter: None 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5638b1604fa0) 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout: cache_index_and_filter_blocks: 1 2024-09-21T07:00:34.361 INFO:journalctl@ceph.mon.c.smithi066.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: pin_top_level_index_and_filter: 1 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: index_type: 0 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: data_block_index_type: 0 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: index_shortening: 1 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: checksum: 4 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: no_block_cache: 0 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_cache: 0x5638ad5c9610 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_cache_name: BinnedLRUCache 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_cache_options: 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: capacity : 536870912 2024-09-21T07:00:34.362 INFO:journalctl@ceph.mon.c.smithi066.stdout: num_shard_bits : 4 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: strict_capacity_limit : 0 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: high_pri_pool_ratio: 0.000 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_cache_compressed: (nil) 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: persistent_cache: (nil) 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_size: 4096 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_size_deviation: 10 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_restart_interval: 16 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: index_block_restart_interval: 1 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: metadata_block_size: 4096 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: partition_filters: 0 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: use_delta_encoding: 1 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: filter_policy: bloomfilter 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: whole_key_filtering: 1 2024-09-21T07:00:34.363 INFO:journalctl@ceph.mon.c.smithi066.stdout: verify_compression: 0 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: read_amp_bytes_per_bit: 0 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: format_version: 5 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: enable_index_compression: 1 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: block_align: 0 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: max_auto_readahead_size: 262144 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: prepopulate_block_cache: 0 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: initial_auto_readahead_size: 8192 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression: NoCompression 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T07:00:34.364 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.num_levels: 7 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:00:34.365 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T07:00:34.366 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T07:00:34.367 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T07:00:34.368 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T07:00:34.368 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T07:00:34.368 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T07:00:34.368 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T07:00:34.368 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T07:00:34.368 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T07:00:34.369 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T07:00:34.369 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T07:00:34.369 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T07:00:34.369 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.inplace_update_support: 0 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.bloom_locality: 0 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.max_successive_merges: 0 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T07:00:34.370 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.ttl: 2592000 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.enable_blob_files: false 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.min_blob_size: 0 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T07:00:34.371 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1bba1347-0cd0-45ee-a3f6-db20e764a950 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902034002214, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902034002650, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726902034, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1bba1347-0cd0-45ee-a3f6-db20e764a950", "db_session_id": "NF30AOTO4Z5EO9EPHNK5", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726902034002748, "job": 1, "event": "recovery_finished"} 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5638b1628a80 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: DB pointer 0x5638b23ce000 2024-09-21T07:00:34.372 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: ** DB Stats ** 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:00:34.373 INFO:journalctl@ceph.mon.c.smithi066.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T07:00:34.374 INFO:journalctl@ceph.mon.c.smithi066.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: Block cache BinnedLRUCache@0x5638ad5c9610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: using public_addr v2:172.21.15.66:0/0 -> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: starting mon.c rank -1 at public addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] at bind addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(???) e0 preinit fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T07:00:34.375 INFO:journalctl@ceph.mon.c.smithi066.stdout: e1 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout: btime 2024-09-21T06:59:06:543660+0000 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout: legacy client fscid: -1 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout: 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout: No filesystems configured 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:00:34.376 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Added host smithi052 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.377 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Deploying cephadm binary to smithi066 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.378 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Added host smithi066 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2449468319' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2449468319' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.379 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.380 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Updating smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi029:172.21.15.29=a;smithi052:172.21.15.52=b;smithi066:172.21.15.66=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Saving service mon spec with placement smithi029:172.21.15.29=a;smithi052:172.21.15.52=b;smithi066:172.21.15.66=c;count:3 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: Deploying daemon mon.c on smithi066 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/1463182249' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 ceph-mon[34793]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T07:00:34.381 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 bash[34774]: ab75bd0e71fc1484b77a913ce290cc2c9834493810e2ac9dff16a0875dc3230a 2024-09-21T07:00:34.382 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:34 smithi066 systemd[1]: Started Ceph mon.c for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:00:34.663 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:00:34.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:00:34.935 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:00:39.332 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:00:39.332 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":2,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","modified":"2024-09-21T07:00:34.030168Z","created":"2024-09-21T06:59:02.874698Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:00:39.332 INFO:teuthology.orchestra.run.smithi066.stderr:dumped monmap epoch 2 2024-09-21T07:00:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: mon.a calling monitor election 2024-09-21T07:00:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: mon.c calling monitor election 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: monmap epoch 2 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: last_changed 2024-09-21T07:00:34.030168+0000 2024-09-21T07:00:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: created 2024-09-21T06:59:02.874698+0000 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: min_mon_release 19 (squid) 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: election_strategy: 1 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: 1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.c 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: fsmap 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: mgrmap e13: x(active, since 43s) 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: overall HEALTH_OK 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:39.353 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:39.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T07:00:39.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: monmap epoch 2 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: last_changed 2024-09-21T07:00:34.030168+0000 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: created 2024-09-21T06:59:02.874698+0000 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: election_strategy: 1 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: 1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.c 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: fsmap 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: mgrmap e13: x(active, since 43s) 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:39.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:40.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:40 smithi066 ceph-mon[34793]: Deploying daemon mon.b on smithi052 2024-09-21T07:00:40.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:40 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/1462983595' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:40.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:40 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:40.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:40 smithi029 ceph-mon[30983]: Deploying daemon mon.b on smithi052 2024-09-21T07:00:40.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:40 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/1462983595' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:40.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:40 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:40.933 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:00:40.933 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:00:41.186 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:00:41.294 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:41 smithi066 ceph-mon[34793]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:41.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:41 smithi029 ceph-mon[30983]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:41.848 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:00:41.848 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":2,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","modified":"2024-09-21T07:00:34.030168Z","created":"2024-09-21T06:59:02.874698Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T07:00:41.848 INFO:teuthology.orchestra.run.smithi066.stderr:dumped monmap epoch 2 2024-09-21T07:00:42.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:42 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/4082370565' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:42.375 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:42 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/4082370565' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:43.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:43 smithi029 ceph-mon[30983]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:43.404 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T07:00:43.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T07:00:43.432 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:43 smithi066 ceph-mon[34793]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:43.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:43 smithi052 systemd[1]: Started Ceph mon.b for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:00:43.663 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:00:48.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:48.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: mon.a calling monitor election 2024-09-21T07:00:48.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: mon.c calling monitor election 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: mon.b calling monitor election 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: monmap epoch 3 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:48.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: last_changed 2024-09-21T07:00:43.164548+0000 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: created 2024-09-21T06:59:02.874698+0000 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: min_mon_release 19 (squid) 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: election_strategy: 1 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: 1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.c 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: fsmap 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: mgrmap e13: x(active, since 52s) 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: overall HEALTH_OK 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.495 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:48.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: mon.a calling monitor election 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: mon.c calling monitor election 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: mon.b calling monitor election 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: monmap epoch 3 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: last_changed 2024-09-21T07:00:43.164548+0000 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: created 2024-09-21T06:59:02.874698+0000 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: min_mon_release 19 (squid) 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: election_strategy: 1 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: 1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.c 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: fsmap 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: mgrmap e13: x(active, since 52s) 2024-09-21T07:00:48.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: overall HEALTH_OK 2024-09-21T07:00:48.604 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.604 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.604 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.604 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:00:48.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: mon.b calling monitor election 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:48.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: monmap epoch 3 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: last_changed 2024-09-21T07:00:43.164548+0000 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: created 2024-09-21T06:59:02.874698+0000 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: election_strategy: 1 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: 1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.c 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: fsmap 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: mgrmap e13: x(active, since 52s) 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T07:00:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:48.787 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:00:48.788 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":3,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","modified":"2024-09-21T07:00:43.164548Z","created":"2024-09-21T06:59:02.874698Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T07:00:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:dumped monmap epoch 3 2024-09-21T07:00:49.404 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:49 smithi066 ceph-mon[34793]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:49.404 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:49 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:49.404 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:49 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/655422789' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:49.404 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:49 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:49.405 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T07:00:49.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T07:00:49.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:49 smithi052 ceph-mon[34308]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:49.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:49 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:49.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:49 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/655422789' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:49.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:49 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:49 smithi029 ceph-mon[30983]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:49 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:49 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/655422789' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T07:00:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:49 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:00:49.669 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:50.417 INFO:teuthology.orchestra.run.smithi029.stdout:# minimal ceph.conf for d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:50.417 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-09-21T07:00:50.417 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:00:50.417 INFO:teuthology.orchestra.run.smithi029.stdout: mon_host = [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] 2024-09-21T07:00:50.658 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.659 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.659 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.659 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.659 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:50.659 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:50.659 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.659 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.660 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.660 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.660 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.660 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.660 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.660 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.660 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.661 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.661 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.661 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:50.661 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:50.661 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:50.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:50.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:50.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:50.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.854 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:50.854 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:50.854 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:50.854 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:51.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-21T07:00:51.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-21T07:00:51.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-21T07:00:51.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:51.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Updating smithi029:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Updating smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.709 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Updating smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:00:51.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: Reconfiguring daemon mon.a on smithi029 2024-09-21T07:00:51.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3692024218' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:51.710 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:51.736 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T07:00:51.736 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:00:51.736 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Updating smithi029:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Updating smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Updating smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: Reconfiguring daemon mon.a on smithi029 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3692024218' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:51.764 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:00:51.764 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:51.831 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T07:00:51.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Updating smithi029:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Updating smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Updating smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: Reconfiguring daemon mon.a on smithi029 2024-09-21T07:00:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3692024218' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:51.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:51.865 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T07:00:51.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:51.933 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T07:00:51.934 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T07:00:51.967 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T07:00:51.967 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T07:00:52.037 INFO:tasks.cephadm:Adding mgr.x on smithi029 2024-09-21T07:00:52.038 INFO:tasks.cephadm:Adding mgr.y on smithi052 2024-09-21T07:00:52.038 INFO:tasks.cephadm:Adding mgr.z on smithi066 2024-09-21T07:00:52.038 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi029=x;smithi052=y;smithi066=z' 2024-09-21T07:00:52.337 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:00:53.001 INFO:teuthology.orchestra.run.smithi066.stdout:Scheduled mgr update... 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:53.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: Reconfiguring daemon mon.b on smithi052 2024-09-21T07:00:53.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.595 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:53.595 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.595 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.595 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:00:53.595 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:53.595 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:53.596 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:53.596 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: Reconfiguring daemon mon.b on smithi052 2024-09-21T07:00:53.596 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.597 DEBUG:teuthology.orchestra.run.smithi052:mgr.y> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T07:00:53.600 DEBUG:teuthology.orchestra.run.smithi066:mgr.z> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T07:00:53.602 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T07:00:53.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T07:00:53.605 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T07:00:53.605 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T07:00:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: Reconfiguring mon.b (monmap changed)... 2024-09-21T07:00:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:53.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:53.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: Reconfiguring daemon mon.b on smithi052 2024-09-21T07:00:53.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:53.622 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T07:00:53.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T07:00:53.666 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T07:00:53.667 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T07:00:53.710 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T07:00:53.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T07:00:53.754 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T07:00:53.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T07:00:53.796 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T07:00:53.797 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T07:00:53.840 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T07:00:53.840 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T07:00:53.883 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T07:00:53.883 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T07:00:53.929 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T07:00:53.929 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T07:00:53.945 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:53.954 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T07:00:53.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T07:00:53.998 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T07:00:53.998 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T07:00:53.999 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:54.051 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T07:00:54.051 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T07:00:54.095 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T07:00:54.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T07:00:54.154 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T07:00:54.154 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T07:00:54.198 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T07:00:54.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T07:00:54.251 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T07:00:54.251 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T07:00:54.302 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T07:00:54.303 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T07:00:54.346 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T07:00:54.346 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T07:00:54.385 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:54 smithi066 ceph-mon[34793]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi029=x;smithi052=y;smithi066=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:54.386 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:54 smithi066 ceph-mon[34793]: Saving service mgr spec with placement smithi029=x;smithi052=y;smithi066=z;count:3 2024-09-21T07:00:54.386 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:54.386 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:54.386 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:54.386 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:54.386 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:54.399 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T07:00:54.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T07:00:54.445 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T07:00:54.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T07:00:54.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:54 smithi029 ceph-mon[30983]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi029=x;smithi052=y;smithi066=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:54.460 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:54 smithi029 ceph-mon[30983]: Saving service mgr spec with placement smithi029=x;smithi052=y;smithi066=z;count:3 2024-09-21T07:00:54.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:54.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:54.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:54.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:54.461 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:54.496 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T07:00:54.496 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T07:00:54.550 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T07:00:54.551 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T07:00:54.595 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T07:00:54.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T07:00:54.651 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T07:00:54.651 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T07:00:54.704 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T07:00:54.704 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T07:00:54.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:54 smithi052 ceph-mon[34308]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi029=x;smithi052=y;smithi066=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:00:54.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:54 smithi052 ceph-mon[34308]: Saving service mgr spec with placement smithi029=x;smithi052=y;smithi066=z;count:3 2024-09-21T07:00:54.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:54.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:54.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T07:00:54.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T07:00:54.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:54.748 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T07:00:54.748 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi029') 2024-09-21T07:00:55.096 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:55.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:00:55.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: Reconfiguring daemon mon.c on smithi066 2024-09-21T07:00:55.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:00:55.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:00:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: Reconfiguring daemon mon.c on smithi066 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:00:55.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: Reconfiguring mon.c (monmap changed)... 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: Reconfiguring daemon mon.c on smithi066 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:00:55.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:55.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:00:55.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:00:55.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:00:55.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:56.446 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:56 smithi066 ceph-mon[34793]: Deploying daemon mgr.z on smithi066 2024-09-21T07:00:56.447 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:56 smithi066 ceph-mon[34793]: from='client.? ' entity='client.admin' 2024-09-21T07:00:56.447 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:56 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3413969113' entity='client.admin' 2024-09-21T07:00:56.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:56 smithi029 ceph-mon[30983]: Deploying daemon mgr.z on smithi066 2024-09-21T07:00:56.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:56 smithi029 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T07:00:56.458 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:56 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3413969113' entity='client.admin' 2024-09-21T07:00:56.684 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:56.722 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi029') 2024-09-21T07:00:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:56 smithi052 ceph-mon[34308]: Deploying daemon mgr.z on smithi066 2024-09-21T07:00:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:56 smithi052 ceph-mon[34308]: from='client.? ' entity='client.admin' 2024-09-21T07:00:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:56 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3413969113' entity='client.admin' 2024-09-21T07:00:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.772+0000 7f3e276c4640 1 -- 172.21.15.29:0/1678817481 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3e0c03fb20 msgr2=0x7f3e0c042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.772+0000 7f3e276c4640 1 --2- 172.21.15.29:0/1678817481 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3e0c03fb20 0x7f3e0c042030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c005f70 tx=0x7f3e1c005fd0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 -- 172.21.15.29:0/1678817481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e20108d00 msgr2=0x7f3e2019c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 --2- 172.21.15.29:0/1678817481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e20108d00 0x7f3e2019c590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000d950 tx=0x7f3e1000de10 comp rx=0 tx=0).stop 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 -- 172.21.15.29:0/1678817481 shutdown_connections 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 --2- 172.21.15.29:0/1678817481 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3e0c03fb20 0x7f3e0c042030 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 --2- 172.21.15.29:0/1678817481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e2010b6b0 0x7f3e2019d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 --2- 172.21.15.29:0/1678817481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e20108d00 0x7f3e2019c590 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 --2- 172.21.15.29:0/1678817481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e2006c490 0x7f3e2019bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 -- 172.21.15.29:0/1678817481 >> 172.21.15.29:0/1678817481 conn(0x7f3e200fdfe0 msgr2=0x7f3e20109c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 -- 172.21.15.29:0/1678817481 shutdown_connections 2024-09-21T07:00:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:56.773+0000 7f3e276c4640 1 -- 172.21.15.29:0/1678817481 wait complete. 2024-09-21T07:00:56.840 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:56 smithi066 systemd[1]: Starting Ceph mgr.z for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:00:57.096 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:56 smithi066 podman[36043]: 2024-09-21 07:00:56.74137538 +0000 UTC m=+0.016531049 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:00:57.097 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:56 smithi066 podman[36043]: 2024-09-21 07:00:56.863255221 +0000 UTC m=+0.138410876 container create 8e9c418118ecad116f6f78584cc6f7ba20b998ec95f47b37a83e3862744a8ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:00:57.097 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:57 smithi066 podman[36043]: 2024-09-21 07:00:57.057011368 +0000 UTC m=+0.332167025 container init 8e9c418118ecad116f6f78584cc6f7ba20b998ec95f47b37a83e3862744a8ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:00:57.098 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:57 smithi066 podman[36043]: 2024-09-21 07:00:57.0601195 +0000 UTC m=+0.335275157 container start 8e9c418118ecad116f6f78584cc6f7ba20b998ec95f47b37a83e3862744a8ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T07:00:57.098 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mgr[36062]: -- 172.21.15.66:0/3601499594 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5609a94b90e0 con 0x5609ae25c480 2024-09-21T07:00:57.351 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:57 smithi066 bash[36043]: 8e9c418118ecad116f6f78584cc6f7ba20b998ec95f47b37a83e3862744a8ed6 2024-09-21T07:00:57.351 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:00:57 smithi066 systemd[1]: Started Ceph mgr.z for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:00:57.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1678817481' entity='client.admin' 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:00:57.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:57.599 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:57.599 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1678817481' entity='client.admin' 2024-09-21T07:00:57.599 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.599 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.599 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.599 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:00:57.599 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:00:57.600 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:00:57.600 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:57.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:57.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1678817481' entity='client.admin' 2024-09-21T07:00:57.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:00:57.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:00:57.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T07:00:57.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:00:57.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:00:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:58.020 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:58.041 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:00:58.155 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi029') 2024-09-21T07:00:58.155 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi029') 2024-09-21T07:00:58.454 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:58 smithi029 ceph-mon[30983]: Deploying daemon mgr.y on smithi052 2024-09-21T07:00:58.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:58 smithi066 ceph-mon[34793]: Deploying daemon mgr.y on smithi052 2024-09-21T07:00:58.722 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:58 smithi052 ceph-mon[34308]: Deploying daemon mgr.y on smithi052 2024-09-21T07:00:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 -- 172.21.15.29:0/1614236136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 msgr2=0x7feb4810b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 --2- 172.21.15.29:0/1614236136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb4810b9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb38009ca0 tx=0x7feb3802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 -- 172.21.15.29:0/1614236136 shutdown_connections 2024-09-21T07:00:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 --2- 172.21.15.29:0/1614236136 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb4810b9a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 --2- 172.21.15.29:0/1614236136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb481068f0 0x7feb48108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 --2- 172.21.15.29:0/1614236136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb4806c6a0 0x7feb481063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 -- 172.21.15.29:0/1614236136 >> 172.21.15.29:0/1614236136 conn(0x7feb480fdfd0 msgr2=0x7feb48100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 -- 172.21.15.29:0/1614236136 shutdown_connections 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.798+0000 7feb5039e640 1 -- 172.21.15.29:0/1614236136 wait complete. 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 Processor -- start 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 -- start start 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb4806c6a0 0x7feb481039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb481068f0 0x7feb481022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb481027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7feb4810f130 con 0x7feb48109490 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb4810efb0 con 0x7feb4806c6a0 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb5039e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feb4810f2b0 con 0x7feb481068f0 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb4e93b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb481027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb4e93b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb481027f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44258/0 (socket says 172.21.15.29:44258) 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb4e93b640 1 -- 172.21.15.29:0/2330217872 learned_addr learned my addr 172.21.15.29:0/2330217872 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb4d939640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb481068f0 0x7feb481022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.799+0000 7feb4e13a640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb4806c6a0 0x7feb481039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb4e93b640 1 -- 172.21.15.29:0/2330217872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb481068f0 msgr2=0x7feb481022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb4e93b640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb481068f0 0x7feb481022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb4e93b640 1 -- 172.21.15.29:0/2330217872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb4806c6a0 msgr2=0x7feb481039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb4e93b640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb4806c6a0 0x7feb481039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb4e93b640 1 -- 172.21.15.29:0/2330217872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb48102ef0 con 0x7feb48109490 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb4e93b640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb481027f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb38006010 tx=0x7feb38003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb477fe640 1 -- 172.21.15.29:0/2330217872 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38004240 con 0x7feb48109490 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb477fe640 1 -- 172.21.15.29:0/2330217872 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7feb38004850 con 0x7feb48109490 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb481a3f30 con 0x7feb48109490 2024-09-21T07:00:58.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb477fe640 1 -- 172.21.15.29:0/2330217872 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb38030be0 con 0x7feb48109490 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.800+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb481a42d0 con 0x7feb48109490 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.801+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb4810f8f0 con 0x7feb48109490 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.801+0000 7feb477fe640 1 -- 172.21.15.29:0/2330217872 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7feb38030d80 con 0x7feb48109490 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.802+0000 7feb477fe640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7feb3003fb20 0x7feb30042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.802+0000 7feb477fe640 1 -- 172.21.15.29:0/2330217872 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feb38075ae0 con 0x7feb48109490 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.802+0000 7feb4e13a640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7feb3003fb20 0x7feb30042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.802+0000 7feb4e13a640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7feb3003fb20 0x7feb30042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb40005d00 tx=0x7feb4000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.806+0000 7feb477fe640 1 -- 172.21.15.29:0/2330217872 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb3804dda0 con 0x7feb48109490 2024-09-21T07:00:58.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 -- 172.21.15.29:0/1598645449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec106900 msgr2=0x7f5cec108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 --2- 172.21.15.29:0/1598645449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec106900 0x7f5cec108d60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009900 tx=0x7f5ce002a410 comp rx=0 tx=0).stop 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 -- 172.21.15.29:0/1598645449 shutdown_connections 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 --2- 172.21.15.29:0/1598645449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cec1094a0 0x7f5cec10b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 --2- 172.21.15.29:0/1598645449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec106900 0x7f5cec108d60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 --2- 172.21.15.29:0/1598645449 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cec06c340 0x7f5cec1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 -- 172.21.15.29:0/1598645449 >> 172.21.15.29:0/1598645449 conn(0x7f5cec0fdfe0 msgr2=0x7f5cec100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 -- 172.21.15.29:0/1598645449 shutdown_connections 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.253+0000 7f5cf163d640 1 -- 172.21.15.29:0/1598645449 wait complete. 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 Processor -- start 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 -- start start 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec06c340 0x7f5cec199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cec106900 0x7f5cec19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cec1094a0 0x7f5cec19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec10f130 con 0x7f5cec06c340 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec10efb0 con 0x7f5cec1094a0 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cf163d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec10f2b0 con 0x7f5cec106900 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec06c340 0x7f5cec199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec06c340 0x7f5cec199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44230/0 (socket says 172.21.15.29:44230) 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5ceaffd640 1 -- 172.21.15.29:0/2744551331 learned_addr learned my addr 172.21.15.29:0/2744551331 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5ceb7fe640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cec1094a0 0x7f5cec19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.254+0000 7f5cea7fc640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cec106900 0x7f5cec19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5ceaffd640 1 -- 172.21.15.29:0/2744551331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cec106900 msgr2=0x7f5cec19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5ceaffd640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cec106900 0x7f5cec19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5ceaffd640 1 -- 172.21.15.29:0/2744551331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cec1094a0 msgr2=0x7f5cec19b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5ceaffd640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cec1094a0 0x7f5cec19b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5ceaffd640 1 -- 172.21.15.29:0/2744551331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec19b850 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5ceaffd640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec06c340 0x7f5cec199e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e9f0 tx=0x7f5cdc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5cd3fff640 1 -- 172.21.15.29:0/2744551331 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00cd80 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5cd3fff640 1 -- 172.21.15.29:0/2744551331 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f5cdc005490 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5cd3fff640 1 -- 172.21.15.29:0/2744551331 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc010430 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec19bb40 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.255+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec1a2240 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.256+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec106d50 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.256+0000 7f5cd3fff640 1 -- 172.21.15.29:0/2744551331 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7f5cdc0105d0 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.256+0000 7f5cd3fff640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5cd403fb20 0x7f5cd4042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.256+0000 7f5cd3fff640 1 -- 172.21.15.29:0/2744551331 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5cdc054900 con 0x7f5cec06c340 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.257+0000 7f5cea7fc640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5cd403fb20 0x7f5cd4042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.257+0000 7f5cea7fc640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5cd403fb20 0x7f5cd4042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009230 tx=0x7f5ce00058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.261+0000 7f5cd3fff640 1 -- 172.21.15.29:0/2744551331 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5cdc016330 con 0x7f5cec06c340 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.452+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5cec063fc0 con 0x7f5cec06c340 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.455+0000 7f5cd3fff640 1 -- 172.21.15.29:0/2744551331 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 120+0+0 (secure 0 0 0) 0x7f5cdc0108c0 con 0x7f5cec06c340 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5cd403fb20 msgr2=0x7f5cd4042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5cd403fb20 0x7f5cd4042030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009230 tx=0x7f5ce00058d0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec06c340 msgr2=0x7f5cec199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec06c340 0x7f5cec199e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00e9f0 tx=0x7f5cdc00edf0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 shutdown_connections 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5cd403fb20 0x7f5cd4042030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5cec1094a0 0x7f5cec19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cec106900 0x7f5cec19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 --2- 172.21.15.29:0/2744551331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cec06c340 0x7f5cec199e20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 >> 172.21.15.29:0/2744551331 conn(0x7f5cec0fdfe0 msgr2=0x7f5cec104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 shutdown_connections 2024-09-21T07:00:58.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:58.458+0000 7f5cf163d640 1 -- 172.21.15.29:0/2744551331 wait complete. 2024-09-21T07:00:58.993 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:58 smithi052 systemd[1]: Starting Ceph mgr.y for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:00:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.000+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7feb4802e640 con 0x7feb48109490 2024-09-21T07:00:59.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.003+0000 7feb477fe640 1 -- 172.21.15.29:0/2330217872 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7feb38039cd0 con 0x7feb48109490 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7feb3003fb20 msgr2=0x7feb30042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7feb3003fb20 0x7feb30042030 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb40005d00 tx=0x7feb4000b410 comp rx=0 tx=0).stop 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 msgr2=0x7feb481027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb481027f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb38006010 tx=0x7feb38003c20 comp rx=0 tx=0).stop 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 shutdown_connections 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7feb3003fb20 0x7feb30042030 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb48109490 0x7feb481027f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb481068f0 0x7feb481022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 --2- 172.21.15.29:0/2330217872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb4806c6a0 0x7feb481039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 >> 172.21.15.29:0/2330217872 conn(0x7feb480fdfd0 msgr2=0x7feb48104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 shutdown_connections 2024-09-21T07:00:59.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:00:59.006+0000 7feb5039e640 1 -- 172.21.15.29:0/2330217872 wait complete. 2024-09-21T07:00:59.450 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:59 smithi052 podman[35114]: 2024-09-21 07:00:59.043376682 +0000 UTC m=+0.015684604 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:00:59.451 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:59 smithi052 podman[35114]: 2024-09-21 07:00:59.146785828 +0000 UTC m=+0.119093743 container create 3ba520efe0b15c5f984dd66797b7d91e5852ec9c0034279458598364151027bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T07:00:59.451 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:59 smithi052 podman[35114]: 2024-09-21 07:00:59.349301416 +0000 UTC m=+0.321609329 container init 3ba520efe0b15c5f984dd66797b7d91e5852ec9c0034279458598364151027bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T07:00:59.451 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:59 smithi052 podman[35114]: 2024-09-21 07:00:59.352032965 +0000 UTC m=+0.324340878 container start 3ba520efe0b15c5f984dd66797b7d91e5852ec9c0034279458598364151027bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T07:00:59.451 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:59 smithi052 ceph-mgr[35133]: -- 172.21.15.52:0/3745822487 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563205a790e0 con 0x563205a97a80 2024-09-21T07:00:59.451 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:59 smithi052 bash[35114]: 3ba520efe0b15c5f984dd66797b7d91e5852ec9c0034279458598364151027bd 2024-09-21T07:00:59.743 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:00:59 smithi052 systemd[1]: Started Ceph mgr.y for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:00:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:59 smithi052 ceph-mon[34308]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:59 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2744551331' entity='client.admin' 2024-09-21T07:00:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:00:59 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2330217872' entity='client.admin' 2024-09-21T07:00:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:59 smithi066 ceph-mon[34793]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:59 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2744551331' entity='client.admin' 2024-09-21T07:00:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:00:59 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2330217872' entity='client.admin' 2024-09-21T07:00:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:59 smithi029 ceph-mon[30983]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:00:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:59 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2744551331' entity='client.admin' 2024-09-21T07:00:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:00:59 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2330217872' entity='client.admin' 2024-09-21T07:01:00.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 -- 172.21.15.29:0/960259834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc1051a0 msgr2=0x7fa4dc10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/960259834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc1051a0 0x7fa4dc10bb40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009900 tx=0x7fa4d402a480 comp rx=0 tx=0).stop 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 -- 172.21.15.29:0/960259834 shutdown_connections 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/960259834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc1051a0 0x7fa4dc10bb40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/960259834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4dc104800 0x7fa4dc104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/960259834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc103770 0x7fa4dc103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 -- 172.21.15.29:0/960259834 >> 172.21.15.29:0/960259834 conn(0x7fa4dc0ff0c0 msgr2=0x7fa4dc101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 -- 172.21.15.29:0/960259834 shutdown_connections 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.310+0000 7fa4e18bc640 1 -- 172.21.15.29:0/960259834 wait complete. 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.311+0000 7fa4e18bc640 1 Processor -- start 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.311+0000 7fa4e18bc640 1 -- start start 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.311+0000 7fa4e18bc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc103770 0x7fa4dc199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.311+0000 7fa4e18bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4dc104800 0x7fa4dc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e18bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc1051a0 0x7fa4dc19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e18bc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc10f190 con 0x7fa4dc103770 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e18bc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc10f010 con 0x7fa4dc104800 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e18bc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc10f310 con 0x7fa4dc1051a0 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc103770 0x7fa4dc199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc103770 0x7fa4dc199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44286/0 (socket says 172.21.15.29:44286) 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 -- 172.21.15.29:0/939846085 learned_addr learned my addr 172.21.15.29:0/939846085 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4da7fc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4dc104800 0x7fa4dc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4db7fe640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc1051a0 0x7fa4dc19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 -- 172.21.15.29:0/939846085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc1051a0 msgr2=0x7fa4dc19afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc1051a0 0x7fa4dc19afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 -- 172.21.15.29:0/939846085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4dc104800 msgr2=0x7fa4dc19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4dc104800 0x7fa4dc19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 -- 172.21.15.29:0/939846085 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc19b7f0 con 0x7fa4dc103770 2024-09-21T07:01:00.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4da7fc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4dc104800 0x7fa4dc19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4daffd640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc103770 0x7fa4dc199dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00cce0 tx=0x7fa4cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc004b20 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fa4cc004cc0 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00f6b0 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.312+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc19bae0 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.313+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1a21e0 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.314+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7fa4cc00f850 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.314+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc103be0 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.314+0000 7fa4e08ba640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa4c803fb20 0x7fa4c8042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.314+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4cc054550 con 0x7fa4dc103770 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.314+0000 7fa4da7fc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa4c803fb20 0x7fa4c8042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.314+0000 7fa4da7fc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa4c803fb20 0x7fa4c8042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009fc0 tx=0x7fa4c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:00.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.318+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4cc014030 con 0x7fa4dc103770 2024-09-21T07:01:00.411 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.415 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.415 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.415 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.418 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.420 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.423 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.424 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.424 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:00.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.569+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fa4dc063fc0 con 0x7fa4dc103770 2024-09-21T07:01:00.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.580+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7fa4cc0152b0 con 0x7fa4dc103770 2024-09-21T07:01:00.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.581+0000 7fa4e08ba640 1 -- 172.21.15.29:0/939846085 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa4cc01f6a0 con 0x7fa4dc103770 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa4c803fb20 msgr2=0x7fa4c8042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa4c803fb20 0x7fa4c8042030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009fc0 tx=0x7fa4c4005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc103770 msgr2=0x7fa4dc199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc103770 0x7fa4dc199dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00cce0 tx=0x7fa4cc00a620 comp rx=0 tx=0).stop 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 shutdown_connections 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa4c803fb20 0x7fa4c8042030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc1051a0 0x7fa4dc19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4dc104800 0x7fa4dc19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 --2- 172.21.15.29:0/939846085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4dc103770 0x7fa4dc199dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 >> 172.21.15.29:0/939846085 conn(0x7fa4dc0ff0c0 msgr2=0x7fa4dc107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 shutdown_connections 2024-09-21T07:01:00.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:00.583+0000 7fa4e18bc640 1 -- 172.21.15.29:0/939846085 wait complete. 2024-09-21T07:01:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:01.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 -- 172.21.15.29:0/1131767603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff824104070 msgr2=0x7ff82410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 --2- 172.21.15.29:0/1131767603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff824104070 0x7ff82410aa10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009ca0 tx=0x7ff81c02a950 comp rx=0 tx=0).stop 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 -- 172.21.15.29:0/1131767603 shutdown_connections 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 --2- 172.21.15.29:0/1131767603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff824104070 0x7ff82410aa10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 --2- 172.21.15.29:0/1131767603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8241036d0 0x7ff824103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 --2- 172.21.15.29:0/1131767603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff824102640 0x7ff824102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 -- 172.21.15.29:0/1131767603 >> 172.21.15.29:0/1131767603 conn(0x7ff8240fdfb0 msgr2=0x7ff824100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 -- 172.21.15.29:0/1131767603 shutdown_connections 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.194+0000 7ff82b194640 1 -- 172.21.15.29:0/1131767603 wait complete. 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 Processor -- start 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 -- start start 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff824102640 0x7ff824199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8241036d0 0x7ff82419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff824104070 0x7ff82419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff82406c4d0 con 0x7ff8241036d0 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff82406c350 con 0x7ff824104070 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff82b194640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff82406c650 con 0x7ff824102640 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.195+0000 7ff823fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8241036d0 0x7ff82419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff823fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8241036d0 0x7ff82419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44304/0 (socket says 172.21.15.29:44304) 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff823fff640 1 -- 172.21.15.29:0/1629214748 learned_addr learned my addr 172.21.15.29:0/1629214748 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff829731640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff824104070 0x7ff82419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff828f30640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff824102640 0x7ff824199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff829731640 1 -- 172.21.15.29:0/1629214748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff824102640 msgr2=0x7ff824199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff829731640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff824102640 0x7ff824199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff829731640 1 -- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8241036d0 msgr2=0x7ff82419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff829731640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8241036d0 0x7ff82419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff829731640 1 -- 172.21.15.29:0/1629214748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82419b8e0 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff829731640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff824104070 0x7ff82419b0c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff81c02ae70 tx=0x7ff81c003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff821ffb640 1 -- 172.21.15.29:0/1629214748 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c034040 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff821ffb640 1 -- 172.21.15.29:0/1629214748 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff81c003e10 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82419bb70 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.196+0000 7ff821ffb640 1 -- 172.21.15.29:0/1629214748 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81c004620 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.197+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8241a2100 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.198+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff824109820 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.198+0000 7ff821ffb640 1 -- 172.21.15.29:0/1629214748 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 51898+0+0 (secure 0 0 0) 0x7ff81c037020 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.198+0000 7ff821ffb640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff81403fb20 0x7ff814042030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.198+0000 7ff821ffb640 1 -- 172.21.15.29:0/1629214748 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff81c0752c0 con 0x7ff824104070 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.198+0000 7ff828f30640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff81403fb20 0x7ff814042030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.199+0000 7ff828f30640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff81403fb20 0x7ff814042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff818009bd0 tx=0x7ff818005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:01.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.204+0000 7ff821ffb640 1 -- 172.21.15.29:0/1629214748 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff81c0098b0 con 0x7ff824104070 2024-09-21T07:01:01.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.400+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7ff82402e640 con 0x7ff824104070 2024-09-21T07:01:01.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.405+0000 7ff821ffb640 1 -- 172.21.15.29:0/1629214748 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7ff81c0047c0 con 0x7ff824104070 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff81403fb20 msgr2=0x7ff814042030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff81403fb20 0x7ff814042030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff818009bd0 tx=0x7ff818005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff824104070 msgr2=0x7ff82419b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff824104070 0x7ff82419b0c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff81c02ae70 tx=0x7ff81c003c20 comp rx=0 tx=0).stop 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 shutdown_connections 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff81403fb20 0x7ff814042030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff824104070 0x7ff82419b0c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8241036d0 0x7ff82419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 --2- 172.21.15.29:0/1629214748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff824102640 0x7ff824199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 >> 172.21.15.29:0/1629214748 conn(0x7ff8240fdfb0 msgr2=0x7ff8241069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:01.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 shutdown_connections 2024-09-21T07:01:01.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:01.408+0000 7ff82b194640 1 -- 172.21.15.29:0/1629214748 wait complete. 2024-09-21T07:01:01.797 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:01.797 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.797 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.797 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/939846085' entity='client.admin' 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: Reconfiguring daemon mgr.x on smithi029 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:01 smithi029 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T07:01:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/939846085' entity='client.admin' 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: Reconfiguring daemon mgr.x on smithi029 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:01 smithi066 ceph-mon[34793]: from='client.? ' entity='client.admin' 2024-09-21T07:01:01.898 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/939846085' entity='client.admin' 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:01.899 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: Reconfiguring daemon mgr.x on smithi029 2024-09-21T07:01:01.900 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:01.900 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:01 smithi052 ceph-mon[34308]: from='client.? ' entity='client.admin' 2024-09-21T07:01:02.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:02 smithi029 ceph-mon[30983]: Standby manager daemon z started 2024-09-21T07:01:02.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:02 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:01:02.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:02 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:01:02.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:02 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:01:02.728 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:02 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:01:02.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:02 smithi066 ceph-mon[34793]: Standby manager daemon z started 2024-09-21T07:01:02.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:02 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:01:02.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:02 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:01:02.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:02 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:01:02.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:02 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:01:02.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:02 smithi052 ceph-mon[34308]: Standby manager daemon z started 2024-09-21T07:01:02.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:02 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T07:01:02.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:02 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:01:02.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:02 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T07:01:02.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:02 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.66:0/3813010817' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 -- 172.21.15.29:0/382432763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 msgr2=0x7fad44102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 --2- 172.21.15.29:0/382432763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad44102b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad40009ca0 tx=0x7fad4002a950 comp rx=0 tx=0).stop 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 -- 172.21.15.29:0/382432763 shutdown_connections 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 --2- 172.21.15.29:0/382432763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad44104110 0x7fad4410aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 --2- 172.21.15.29:0/382432763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad44103770 0x7fad44103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 --2- 172.21.15.29:0/382432763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad44102b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 -- 172.21.15.29:0/382432763 >> 172.21.15.29:0/382432763 conn(0x7fad440fe050 msgr2=0x7fad44100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 -- 172.21.15.29:0/382432763 shutdown_connections 2024-09-21T07:01:03.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.851+0000 7fad4c286640 1 -- 172.21.15.29:0/382432763 wait complete. 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 Processor -- start 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 -- start start 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad441062d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad44103770 0x7fad44104ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad44104110 0x7fad441050e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fad4410e170 con 0x7fad441026e0 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad4410dff0 con 0x7fad44104110 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4c286640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad4410e2f0 con 0x7fad44103770 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad441062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad441062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44348/0 (socket says 172.21.15.29:44348) 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 -- 172.21.15.29:0/1232394424 learned_addr learned my addr 172.21.15.29:0/1232394424 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a823640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad44104110 0x7fad441050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad49821640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad44103770 0x7fad44104ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 -- 172.21.15.29:0/1232394424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad44103770 msgr2=0x7fad44104ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad44103770 0x7fad44104ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 -- 172.21.15.29:0/1232394424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad44104110 msgr2=0x7fad441050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad44104110 0x7fad441050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.852+0000 7fad4a022640 1 -- 172.21.15.29:0/1232394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad441057e0 con 0x7fad441026e0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.853+0000 7fad4a022640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad441062d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fad40009880 tx=0x7fad40003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.853+0000 7fad3b7fe640 1 -- 172.21.15.29:0/1232394424 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40034040 con 0x7fad441026e0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.853+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad441a3fa0 con 0x7fad441026e0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.853+0000 7fad3b7fe640 1 -- 172.21.15.29:0/1232394424 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fad4002fe00 con 0x7fad441026e0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.853+0000 7fad3b7fe640 1 -- 172.21.15.29:0/1232394424 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad400046a0 con 0x7fad441026e0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.853+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad441a4340 con 0x7fad441026e0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.854+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad441a4510 con 0x7fad441026e0 2024-09-21T07:01:03.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.855+0000 7fad3b7fe640 1 -- 172.21.15.29:0/1232394424 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7fad40037020 con 0x7fad441026e0 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.855+0000 7fad3b7fe640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fad3007afd0 0x7fad3007d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.855+0000 7fad3b7fe640 1 -- 172.21.15.29:0/1232394424 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fad400bdb70 con 0x7fad441026e0 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.856+0000 7fad49821640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fad3007afd0 0x7fad3007d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.856+0000 7fad49821640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fad3007afd0 0x7fad3007d4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad34009bd0 tx=0x7fad34005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.860+0000 7fad3b7fe640 1 -- 172.21.15.29:0/1232394424 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad400098b0 con 0x7fad441026e0 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.057+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fad441a47c0 con 0x7fad441026e0 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.060+0000 7fad3b7fe640 1 -- 172.21.15.29:0/1232394424 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fad4008a5d0 con 0x7fad441026e0 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.062+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fad3007afd0 msgr2=0x7fad3007d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.062+0000 7fad4c286640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fad3007afd0 0x7fad3007d4e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad34009bd0 tx=0x7fad34005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.062+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 msgr2=0x7fad441062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.062+0000 7fad4c286640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad441062d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fad40009880 tx=0x7fad40003c90 comp rx=0 tx=0).stop 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.062+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 shutdown_connections 2024-09-21T07:01:03.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.063+0000 7fad4c286640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fad3007afd0 0x7fad3007d4e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.063+0000 7fad4c286640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad44104110 0x7fad441050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.063+0000 7fad4c286640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad44103770 0x7fad44104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.063+0000 7fad4c286640 1 --2- 172.21.15.29:0/1232394424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad441026e0 0x7fad441062d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.063+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 >> 172.21.15.29:0/1232394424 conn(0x7fad440fe050 msgr2=0x7fad440ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:03.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.063+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 shutdown_connections 2024-09-21T07:01:03.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.063+0000 7fad4c286640 1 -- 172.21.15.29:0/1232394424 wait complete. 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 -- 172.21.15.29:0/4202669114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c109470 msgr2=0x7f4e6c10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 --2- 172.21.15.29:0/4202669114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c109470 0x7f4e6c10b980 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009ca0 tx=0x7f4e6402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 -- 172.21.15.29:0/4202669114 shutdown_connections 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 --2- 172.21.15.29:0/4202669114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c109470 0x7f4e6c10b980 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 --2- 172.21.15.29:0/4202669114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e6c106930 0x7f4e6c108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 --2- 172.21.15.29:0/4202669114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e6c06b920 0x7f4e6c1063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 -- 172.21.15.29:0/4202669114 >> 172.21.15.29:0/4202669114 conn(0x7f4e6c0fdfb0 msgr2=0x7f4e6c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 -- 172.21.15.29:0/4202669114 shutdown_connections 2024-09-21T07:01:03.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.574+0000 7f4e7411e640 1 -- 172.21.15.29:0/4202669114 wait complete. 2024-09-21T07:01:03.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 Processor -- start 2024-09-21T07:01:03.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 -- start start 2024-09-21T07:01:03.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c06b920 0x7f4e6c199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e6c106930 0x7f4e6c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e6c109470 0x7f4e6c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c10f220 con 0x7f4e6c06b920 2024-09-21T07:01:03.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c10f0a0 con 0x7f4e6c106930 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.575+0000 7f4e7411e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c10f3a0 con 0x7f4e6c109470 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c06b920 0x7f4e6c199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e716b9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e6c106930 0x7f4e6c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c06b920 0x7f4e6c199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44354/0 (socket says 172.21.15.29:44354) 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 -- 172.21.15.29:0/2973428026 learned_addr learned my addr 172.21.15.29:0/2973428026 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e726bb640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e6c109470 0x7f4e6c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 -- 172.21.15.29:0/2973428026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e6c109470 msgr2=0x7f4e6c19b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e6c109470 0x7f4e6c19b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 -- 172.21.15.29:0/2973428026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e6c106930 msgr2=0x7f4e6c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e6c106930 0x7f4e6c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 -- 172.21.15.29:0/2973428026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c19b870 con 0x7f4e6c06b920 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e726bb640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e6c109470 0x7f4e6c19b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:03.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e71eba640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c06b920 0x7f4e6c199e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800ea60 tx=0x7f4e6800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e62ffd640 1 -- 172.21.15.29:0/2973428026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800cde0 con 0x7f4e6c06b920 2024-09-21T07:01:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e62ffd640 1 -- 172.21.15.29:0/2973428026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4e680035f0 con 0x7f4e6c06b920 2024-09-21T07:01:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e62ffd640 1 -- 172.21.15.29:0/2973428026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68010690 con 0x7f4e6c06b920 2024-09-21T07:01:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.576+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c19bb60 con 0x7f4e6c06b920 2024-09-21T07:01:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.577+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c1a2260 con 0x7f4e6c06b920 2024-09-21T07:01:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.578+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6c106d40 con 0x7f4e6c06b920 2024-09-21T07:01:03.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.578+0000 7f4e62ffd640 1 -- 172.21.15.29:0/2973428026 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f4e68004000 con 0x7f4e6c06b920 2024-09-21T07:01:03.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.579+0000 7f4e62ffd640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e5807afd0 0x7f4e5807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.579+0000 7f4e716b9640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e5807afd0 0x7f4e5807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.579+0000 7f4e62ffd640 1 -- 172.21.15.29:0/2973428026 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4e6809d060 con 0x7f4e6c06b920 2024-09-21T07:01:03.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.580+0000 7f4e716b9640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e5807afd0 0x7f4e5807d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0095f0 tx=0x7f4e5c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:03.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.585+0000 7f4e62ffd640 1 -- 172.21.15.29:0/2973428026 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e680656e0 con 0x7f4e6c06b920 2024-09-21T07:01:03.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.776+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f4e6c0ffad0 con 0x7f4e6c06b920 2024-09-21T07:01:03.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:03 smithi029 ceph-mon[30983]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:03.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:03 smithi029 ceph-mon[30983]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-21T07:01:03.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:01:03.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:03 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/863469430' entity='client.admin' 2024-09-21T07:01:03.779 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:03 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1232394424' entity='client.admin' 2024-09-21T07:01:03.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.780+0000 7f4e62ffd640 1 -- 172.21.15.29:0/2973428026 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v19)=0 v19) ==== 119+0+0 (secure 0 0 0) 0x7f4e68069ac0 con 0x7f4e6c06b920 2024-09-21T07:01:03.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e5807afd0 msgr2=0x7f4e5807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e5807afd0 0x7f4e5807d4e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0095f0 tx=0x7f4e5c005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:03.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c06b920 msgr2=0x7f4e6c199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c06b920 0x7f4e6c199e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800ea60 tx=0x7f4e6800ef20 comp rx=0 tx=0).stop 2024-09-21T07:01:03.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 shutdown_connections 2024-09-21T07:01:03.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e5807afd0 0x7f4e5807d4e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e6c109470 0x7f4e6c19b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e6c106930 0x7f4e6c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 --2- 172.21.15.29:0/2973428026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c06b920 0x7f4e6c199e40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 >> 172.21.15.29:0/2973428026 conn(0x7f4e6c0fdfb0 msgr2=0x7f4e6c104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:03.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 shutdown_connections 2024-09-21T07:01:03.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:03.783+0000 7f4e7411e640 1 -- 172.21.15.29:0/2973428026 wait complete. 2024-09-21T07:01:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:03 smithi066 ceph-mon[34793]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:03 smithi066 ceph-mon[34793]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-21T07:01:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:01:03.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:03 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/863469430' entity='client.admin' 2024-09-21T07:01:03.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:03 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1232394424' entity='client.admin' 2024-09-21T07:01:03.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:03 smithi052 ceph-mon[34308]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:03 smithi052 ceph-mon[34308]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-21T07:01:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T07:01:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:03 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/863469430' entity='client.admin' 2024-09-21T07:01:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:03 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1232394424' entity='client.admin' 2024-09-21T07:01:05.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2973428026' entity='client.admin' 2024-09-21T07:01:05.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:05.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2197359100' entity='client.admin' 2024-09-21T07:01:05.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: Standby manager daemon y started 2024-09-21T07:01:05.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:01:05.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:01:05.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:01:05.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:04 smithi066 ceph-mon[34793]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:01:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2973428026' entity='client.admin' 2024-09-21T07:01:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2197359100' entity='client.admin' 2024-09-21T07:01:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: Standby manager daemon y started 2024-09-21T07:01:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:01:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:01:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:01:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:04 smithi029 ceph-mon[30983]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2973428026' entity='client.admin' 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2197359100' entity='client.admin' 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: Standby manager daemon y started 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T07:01:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:04 smithi052 ceph-mon[34308]: from='mgr.? 172.21.15.52:0/4097870602' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.018+0000 7f9183843640 1 -- 172.21.15.29:0/3376243886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c109480 msgr2=0x7f917c10b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.018+0000 7f9183843640 1 --2- 172.21.15.29:0/3376243886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c109480 0x7f917c10b990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9174009ca0 tx=0x7f917402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 -- 172.21.15.29:0/3376243886 shutdown_connections 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 --2- 172.21.15.29:0/3376243886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c109480 0x7f917c10b990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 --2- 172.21.15.29:0/3376243886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917c106970 0x7f917c108d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 --2- 172.21.15.29:0/3376243886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c06b8e0 0x7f917c106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 -- 172.21.15.29:0/3376243886 >> 172.21.15.29:0/3376243886 conn(0x7f917c0fdfb0 msgr2=0x7f917c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 -- 172.21.15.29:0/3376243886 shutdown_connections 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 -- 172.21.15.29:0/3376243886 wait complete. 2024-09-21T07:01:06.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 Processor -- start 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.019+0000 7f9183843640 1 -- start start 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9183843640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06b8e0 0x7f917c199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9183843640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917c106970 0x7f917c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9183843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c109480 0x7f917c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9183843640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f917c10f250 con 0x7f917c06b8e0 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9183843640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f917c10f0d0 con 0x7f917c109480 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9183843640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f917c10f3d0 con 0x7f917c106970 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06b8e0 0x7f917c199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06b8e0 0x7f917c199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44380/0 (socket says 172.21.15.29:44380) 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 -- 172.21.15.29:0/2197359100 learned_addr learned my addr 172.21.15.29:0/2197359100 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9181de0640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c109480 0x7f917c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f9180dde640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917c106970 0x7f917c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 -- 172.21.15.29:0/2197359100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917c106970 msgr2=0x7f917c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917c106970 0x7f917c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 -- 172.21.15.29:0/2197359100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c109480 msgr2=0x7f917c19b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c109480 0x7f917c19b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 -- 172.21.15.29:0/2197359100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c19b8b0 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.020+0000 7f91815df640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06b8e0 0x7f917c199e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f917800e9f0 tx=0x7f917800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.021+0000 7f91727fc640 1 -- 172.21.15.29:0/2197359100 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917800cd80 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.021+0000 7f91727fc640 1 -- 172.21.15.29:0/2197359100 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f91780108c0 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.021+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917c19bba0 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.021+0000 7f91727fc640 1 -- 172.21.15.29:0/2197359100 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91780187d0 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.021+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917c1a22a0 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.022+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917c106d80 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.022+0000 7f91727fc640 1 -- 172.21.15.29:0/2197359100 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7f91780189b0 con 0x7f917c06b8e0 2024-09-21T07:01:06.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.023+0000 7f91727fc640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f916807afd0 0x7f916807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.023+0000 7f91727fc640 1 -- 172.21.15.29:0/2197359100 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f917809d130 con 0x7f917c06b8e0 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.023+0000 7f9180dde640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f916807afd0 0x7f916807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.023+0000 7f9180dde640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f916807afd0 0x7f916807d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f916c005fd0 tx=0x7f916c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.028+0000 7f91727fc640 1 -- 172.21.15.29:0/2197359100 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f917806eb00 con 0x7f917c06b8e0 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.217+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f917c063fc0 con 0x7f917c06b8e0 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.221+0000 7f91727fc640 1 -- 172.21.15.29:0/2197359100 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f9178010d50 con 0x7f917c06b8e0 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f916807afd0 msgr2=0x7f916807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f916807afd0 0x7f916807d4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f916c005fd0 tx=0x7f916c00b390 comp rx=0 tx=0).stop 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06b8e0 msgr2=0x7f917c199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06b8e0 0x7f917c199e80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f917800e9f0 tx=0x7f917800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 shutdown_connections 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f916807afd0 0x7f916807d4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917c109480 0x7f917c19b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917c106970 0x7f917c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 --2- 172.21.15.29:0/2197359100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06b8e0 0x7f917c199e80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.223+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 >> 172.21.15.29:0/2197359100 conn(0x7f917c0fdfb0 msgr2=0x7f917c104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.224+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 shutdown_connections 2024-09-21T07:01:06.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:04.224+0000 7f9183843640 1 -- 172.21.15.29:0/2197359100 wait complete. 2024-09-21T07:01:06.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:06 smithi029 ceph-mon[30983]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-21T07:01:06.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:06 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:01:06.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:06 smithi052 ceph-mon[34308]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-21T07:01:06.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:06 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:01:06.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:06 smithi066 ceph-mon[34793]: mgrmap e15: x(active, since 69s), standbys: z, y 2024-09-21T07:01:06.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:06 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 -- 172.21.15.29:0/3499447846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 msgr2=0x7f6a2c102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 --2- 172.21.15.29:0/3499447846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c102ae0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009900 tx=0x7f6a2802a480 comp rx=0 tx=0).stop 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 -- 172.21.15.29:0/3499447846 shutdown_connections 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 --2- 172.21.15.29:0/3499447846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a2c1040a0 0x7f6a2c10aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 --2- 172.21.15.29:0/3499447846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c103700 0x7f6a2c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 --2- 172.21.15.29:0/3499447846 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c102ae0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 -- 172.21.15.29:0/3499447846 >> 172.21.15.29:0/3499447846 conn(0x7f6a2c0fdfe0 msgr2=0x7f6a2c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 -- 172.21.15.29:0/3499447846 shutdown_connections 2024-09-21T07:01:06.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.614+0000 7f6a33701640 1 -- 172.21.15.29:0/3499447846 wait complete. 2024-09-21T07:01:06.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 Processor -- start 2024-09-21T07:01:06.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 -- start start 2024-09-21T07:01:06.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a2c103700 0x7f6a2c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c1040a0 0x7f6a2c19b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c10e170 con 0x7f6a2c102670 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c10dff0 con 0x7f6a2c1040a0 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a33701640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c10e2f0 con 0x7f6a2c103700 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a3149d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a3149d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44398/0 (socket says 172.21.15.29:44398) 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a3149d640 1 -- 172.21.15.29:0/4063699992 learned_addr learned my addr 172.21.15.29:0/4063699992 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a31c9e640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c1040a0 0x7f6a2c19b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.615+0000 7f6a30c9c640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a2c103700 0x7f6a2c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a3149d640 1 -- 172.21.15.29:0/4063699992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a2c103700 msgr2=0x7f6a2c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a3149d640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a2c103700 0x7f6a2c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a3149d640 1 -- 172.21.15.29:0/4063699992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c1040a0 msgr2=0x7f6a2c19b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a3149d640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c1040a0 0x7f6a2c19b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a3149d640 1 -- 172.21.15.29:0/4063699992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c19b950 con 0x7f6a2c102670 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a3149d640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c199f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a28004770 tx=0x7f6a280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2803f030 con 0x7f6a2c102670 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6a28003c90 con 0x7f6a2c102670 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c19bbe0 con 0x7f6a2c102670 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28035070 con 0x7f6a2c102670 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.616+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c1a2170 con 0x7f6a2c102670 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.617+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c1a23d0 con 0x7f6a2c102670 2024-09-21T07:01:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.619+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f6a28042030 con 0x7f6a2c102670 2024-09-21T07:01:06.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.620+0000 7f6a227fc640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a180b6480 0x7f6a180b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.620+0000 7f6a30c9c640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a180b6480 0x7f6a180b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.620+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6a28106370 con 0x7f6a2c102670 2024-09-21T07:01:06.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.620+0000 7f6a30c9c640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a180b6480 0x7f6a180b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00bbe0 tx=0x7f6a1c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:06.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.623+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a280d2cb0 con 0x7f6a2c102670 2024-09-21T07:01:06.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.814+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f6a2c1a25a0 con 0x7f6a2c102670 2024-09-21T07:01:06.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.818+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v21)=0 v21) ==== 123+0+0 (secure 0 0 0) 0x7f6a280d7bf0 con 0x7f6a2c102670 2024-09-21T07:01:06.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.819+0000 7f6a227fc640 1 -- 172.21.15.29:0/4063699992 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a28003e40 con 0x7f6a2c102670 2024-09-21T07:01:06.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a180b6480 msgr2=0x7f6a180b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a180b6480 0x7f6a180b8990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00bbe0 tx=0x7f6a1c00b390 comp rx=0 tx=0).stop 2024-09-21T07:01:06.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 msgr2=0x7f6a2c199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c199f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a28004770 tx=0x7f6a280042f0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 shutdown_connections 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a180b6480 0x7f6a180b8990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a2c1040a0 0x7f6a2c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a2c103700 0x7f6a2c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 --2- 172.21.15.29:0/4063699992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a2c102670 0x7f6a2c199f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.820+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 >> 172.21.15.29:0/4063699992 conn(0x7f6a2c0fdfe0 msgr2=0x7f6a2c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.821+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 shutdown_connections 2024-09-21T07:01:06.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:06.821+0000 7f6a33701640 1 -- 172.21.15.29:0/4063699992 wait complete. 2024-09-21T07:01:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.367+0000 7f74c40e8640 1 -- 172.21.15.29:0/255660054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc102670 msgr2=0x7f74bc102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.367+0000 7f74c40e8640 1 --2- 172.21.15.29:0/255660054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc102670 0x7f74bc102ae0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009900 tx=0x7f74b802a480 comp rx=0 tx=0).stop 2024-09-21T07:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.367+0000 7f74c40e8640 1 -- 172.21.15.29:0/255660054 shutdown_connections 2024-09-21T07:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.367+0000 7f74c40e8640 1 --2- 172.21.15.29:0/255660054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74bc1040a0 0x7f74bc10aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.367+0000 7f74c40e8640 1 --2- 172.21.15.29:0/255660054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc103700 0x7f74bc103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.367+0000 7f74c40e8640 1 --2- 172.21.15.29:0/255660054 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc102670 0x7f74bc102ae0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.367+0000 7f74c40e8640 1 -- 172.21.15.29:0/255660054 >> 172.21.15.29:0/255660054 conn(0x7f74bc0fdfe0 msgr2=0x7f74bc100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.368+0000 7f74c40e8640 1 -- 172.21.15.29:0/255660054 shutdown_connections 2024-09-21T07:01:07.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.368+0000 7f74c40e8640 1 -- 172.21.15.29:0/255660054 wait complete. 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.368+0000 7f74c40e8640 1 Processor -- start 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.368+0000 7f74c40e8640 1 -- start start 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c40e8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74bc102670 0x7f74bc06c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c40e8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc103700 0x7f74bc19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c40e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc1040a0 0x7f74bc1a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c40e8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc10e290 con 0x7f74bc1040a0 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c40e8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc10e110 con 0x7f74bc103700 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c40e8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f74bc10e410 con 0x7f74bc102670 2024-09-21T07:01:07.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc1040a0 0x7f74bc1a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc1040a0 0x7f74bc1a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54462/0 (socket says 172.21.15.29:54462) 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 -- 172.21.15.29:0/1973572644 learned_addr learned my addr 172.21.15.29:0/1973572644 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c1e84640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74bc102670 0x7f74bc06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c1683640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc103700 0x7f74bc19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 -- 172.21.15.29:0/1973572644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74bc102670 msgr2=0x7f74bc06c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74bc102670 0x7f74bc06c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 -- 172.21.15.29:0/1973572644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc103700 msgr2=0x7f74bc19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc103700 0x7f74bc19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.369+0000 7f74c2685640 1 -- 172.21.15.29:0/1973572644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74bc1a1ac0 con 0x7f74bc1040a0 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.370+0000 7f74c2685640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc1040a0 0x7f74bc1a12c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74b400eb10 tx=0x7f74b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.370+0000 7f74b2ffd640 1 -- 172.21.15.29:0/1973572644 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4004b20 con 0x7f74bc1040a0 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.370+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74bc1a1db0 con 0x7f74bc1040a0 2024-09-21T07:01:07.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.370+0000 7f74b2ffd640 1 -- 172.21.15.29:0/1973572644 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74b4004cc0 con 0x7f74bc1040a0 2024-09-21T07:01:07.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.370+0000 7f74b2ffd640 1 -- 172.21.15.29:0/1973572644 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4010670 con 0x7f74bc1040a0 2024-09-21T07:01:07.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.370+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74bc1a2210 con 0x7f74bc1040a0 2024-09-21T07:01:07.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.371+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74bc109850 con 0x7f74bc1040a0 2024-09-21T07:01:07.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.373+0000 7f74b2ffd640 1 -- 172.21.15.29:0/1973572644 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f74b4005000 con 0x7f74bc1040a0 2024-09-21T07:01:07.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.373+0000 7f74b2ffd640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f74a80b6500 0x7f74a80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.374+0000 7f74c1e84640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f74a80b6500 0x7f74a80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.374+0000 7f74b2ffd640 1 -- 172.21.15.29:0/1973572644 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f74b40e5d80 con 0x7f74bc1040a0 2024-09-21T07:01:07.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.374+0000 7f74c1e84640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f74a80b6500 0x7f74a80b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000c00 tx=0x7f74b8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.377+0000 7f74b2ffd640 1 -- 172.21.15.29:0/1973572644 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f74b4056710 con 0x7f74bc1040a0 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 -- 172.21.15.29:0/3071732024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2101094b0 msgr2=0x7fb21010b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 --2- 172.21.15.29:0/3071732024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2101094b0 0x7fb21010b9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb208009ca0 tx=0x7fb20802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 -- 172.21.15.29:0/3071732024 shutdown_connections 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 --2- 172.21.15.29:0/3071732024 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2101094b0 0x7fb21010b9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 --2- 172.21.15.29:0/3071732024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2101025b0 0x7fb210108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 --2- 172.21.15.29:0/3071732024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb210101b80 0x7fb210101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 -- 172.21.15.29:0/3071732024 >> 172.21.15.29:0/3071732024 conn(0x7fb2100fd770 msgr2=0x7fb2100ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 -- 172.21.15.29:0/3071732024 shutdown_connections 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.725+0000 7fb21651b640 1 -- 172.21.15.29:0/3071732024 wait complete. 2024-09-21T07:01:07.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 Processor -- start 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 -- start start 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb210101b80 0x7fb210199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2101025b0 0x7fb21019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2101094b0 0x7fb21019b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb21010f260 con 0x7fb210101b80 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb21010f0e0 con 0x7fb2101094b0 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb21651b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb21010f3e0 con 0x7fb2101025b0 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb210101b80 0x7fb210199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb20f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2101025b0 0x7fb21019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb210101b80 0x7fb210199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44326/0 (socket says 172.21.15.29:44326) 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb20ffff640 1 -- 172.21.15.29:0/863469430 learned_addr learned my addr 172.21.15.29:0/863469430 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:07.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.726+0000 7fb214ab8640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2101094b0 0x7fb21019b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20ffff640 1 -- 172.21.15.29:0/863469430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2101025b0 msgr2=0x7fb21019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20ffff640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2101025b0 0x7fb21019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20ffff640 1 -- 172.21.15.29:0/863469430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2101094b0 msgr2=0x7fb21019b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20ffff640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2101094b0 0x7fb21019b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20ffff640 1 -- 172.21.15.29:0/863469430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21019b870 con 0x7fb210101b80 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20f7fe640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2101025b0 0x7fb21019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb214ab8640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2101094b0 0x7fb21019b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20ffff640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb210101b80 0x7fb210199e40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e9f0 tx=0x7fb20000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20d7fa640 1 -- 172.21.15.29:0/863469430 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20000cd80 con 0x7fb210101b80 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20d7fa640 1 -- 172.21.15.29:0/863469430 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb2000108c0 con 0x7fb210101b80 2024-09-21T07:01:07.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21019bb60 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb20d7fa640 1 -- 172.21.15.29:0/863469430 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2000187d0 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.727+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2101a2260 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.728+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2100ff290 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.729+0000 7fb20d7fa640 1 -- 172.21.15.29:0/863469430 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 14) ==== 103177+0+0 (secure 0 0 0) 0x7fb200010430 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.730+0000 7fb20d7fa640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb1f807afd0 0x7fb1f807d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.730+0000 7fb20f7fe640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb1f807afd0 0x7fb1f807d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.730+0000 7fb20d7fa640 1 -- 172.21.15.29:0/863469430 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb20009d130 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.730+0000 7fb20f7fe640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb1f807afd0 0x7fb1f807d4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb204005d00 tx=0x7fb20400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.735+0000 7fb20d7fa640 1 -- 172.21.15.29:0/863469430 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb200069c50 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.928+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fb210063fc0 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.933+0000 7fb20d7fa640 1 -- 172.21.15.29:0/863469430 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7fb20006eb00 con 0x7fb210101b80 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb1f807afd0 msgr2=0x7fb1f807d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb1f807afd0 0x7fb1f807d4e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb204005d00 tx=0x7fb20400b410 comp rx=0 tx=0).stop 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb210101b80 msgr2=0x7fb210199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb210101b80 0x7fb210199e40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb20000e9f0 tx=0x7fb20000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 shutdown_connections 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb1f807afd0 0x7fb1f807d4e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2101094b0 0x7fb21019b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2101025b0 0x7fb21019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 --2- 172.21.15.29:0/863469430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb210101b80 0x7fb210199e40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 >> 172.21.15.29:0/863469430 conn(0x7fb2100fd770 msgr2=0x7fb210107790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 shutdown_connections 2024-09-21T07:01:07.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:02.935+0000 7fb21651b640 1 -- 172.21.15.29:0/863469430 wait complete. 2024-09-21T07:01:07.489 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:07 smithi029 ceph-mon[30983]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:07.489 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:07 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4063699992' entity='client.admin' 2024-09-21T07:01:07.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:07 smithi052 ceph-mon[34308]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:07.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:07 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4063699992' entity='client.admin' 2024-09-21T07:01:07.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.568+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f74bc02e640 con 0x7f74bc1040a0 2024-09-21T07:01:07.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.572+0000 7f74b2ffd640 1 -- 172.21.15.29:0/1973572644 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v22)=0 v22) ==== 111+0+0 (secure 0 0 0) 0x7f74b40ae2e0 con 0x7f74bc1040a0 2024-09-21T07:01:07.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.574+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f74a80b6500 msgr2=0x7f74a80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.574+0000 7f74c40e8640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f74a80b6500 0x7f74a80b8a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000c00 tx=0x7f74b8031400 comp rx=0 tx=0).stop 2024-09-21T07:01:07.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.574+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc1040a0 msgr2=0x7f74bc1a12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.574+0000 7f74c40e8640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc1040a0 0x7f74bc1a12c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74b400eb10 tx=0x7f74b400c2d0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 shutdown_connections 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f74a80b6500 0x7f74a80b8a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74bc1040a0 0x7f74bc1a12c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74bc103700 0x7f74bc19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 --2- 172.21.15.29:0/1973572644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74bc102670 0x7f74bc06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 >> 172.21.15.29:0/1973572644 conn(0x7f74bc0fdfe0 msgr2=0x7f74bc106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 shutdown_connections 2024-09-21T07:01:07.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:07.575+0000 7f74c40e8640 1 -- 172.21.15.29:0/1973572644 wait complete. 2024-09-21T07:01:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:07 smithi066 ceph-mon[34793]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:07 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4063699992' entity='client.admin' 2024-09-21T07:01:08.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:08 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1973572644' entity='client.admin' 2024-09-21T07:01:08.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:08 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1973572644' entity='client.admin' 2024-09-21T07:01:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:08 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1973572644' entity='client.admin' 2024-09-21T07:01:09.398 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.399 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.399 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.400 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.529 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.529 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.530 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:09.827 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:09 smithi029 ceph-mon[30983]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:09.827 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.827 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.828 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:09.828 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:09.828 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:09.828 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:09 smithi066 ceph-mon[34793]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:09.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:09.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:09.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:09.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.894 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:09 smithi052 ceph-mon[34308]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:09.895 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.895 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:09.895 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:09.895 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:09.895 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:09.895 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 -- 172.21.15.29:0/3493446259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 msgr2=0x7fda8410aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/3493446259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8410aa10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009ca0 tx=0x7fda7c02a950 comp rx=0 tx=0).stop 2024-09-21T07:01:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 -- 172.21.15.29:0/3493446259 shutdown_connections 2024-09-21T07:01:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/3493446259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8410aa10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/3493446259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda841036d0 0x7fda84103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/3493446259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 0x7fda84102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 -- 172.21.15.29:0/3493446259 >> 172.21.15.29:0/3493446259 conn(0x7fda840fdfb0 msgr2=0x7fda84100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:10.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 -- 172.21.15.29:0/3493446259 shutdown_connections 2024-09-21T07:01:10.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.339+0000 7fda8bcd5640 1 -- 172.21.15.29:0/3493446259 wait complete. 2024-09-21T07:01:10.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 Processor -- start 2024-09-21T07:01:10.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 -- start start 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 0x7fda8419c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda841036d0 0x7fda8419c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8419d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fda8410e2c0 con 0x7fda84104070 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda8410e140 con 0x7fda841036d0 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8bcd5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fda8410e440 con 0x7fda84102640 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8a272640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8419d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda89a71640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 0x7fda8419c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8a272640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8419d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54480/0 (socket says 172.21.15.29:54480) 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda89a71640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 0x7fda8419c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.29:33544/0 (socket says 172.21.15.29:33544) 2024-09-21T07:01:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda8a272640 1 -- 172.21.15.29:0/1840405712 learned_addr learned my addr 172.21.15.29:0/1840405712 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.340+0000 7fda89270640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda841036d0 0x7fda8419c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda89a71640 1 -- 172.21.15.29:0/1840405712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda841036d0 msgr2=0x7fda8419c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda89a71640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda841036d0 0x7fda8419c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda89a71640 1 -- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 msgr2=0x7fda8419d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda89a71640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8419d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda89a71640 1 -- 172.21.15.29:0/1840405712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8419dbb0 con 0x7fda84102640 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda8a272640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8419d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda89a71640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 0x7fda8419c180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda8000e9f0 tx=0x7fda8000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda7affd640 1 -- 172.21.15.29:0/1840405712 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8000ccc0 con 0x7fda84102640 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda7affd640 1 -- 172.21.15.29:0/1840405712 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda800108e0 con 0x7fda84102640 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda7affd640 1 -- 172.21.15.29:0/1840405712 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80018880 con 0x7fda84102640 2024-09-21T07:01:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8419dea0 con 0x7fda84102640 2024-09-21T07:01:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.341+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda841a45a0 con 0x7fda84102640 2024-09-21T07:01:10.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.342+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda841a4770 con 0x7fda84102640 2024-09-21T07:01:10.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.344+0000 7fda7affd640 1 -- 172.21.15.29:0/1840405712 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fda80010430 con 0x7fda84102640 2024-09-21T07:01:10.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.345+0000 7fda7affd640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fda700b6480 0x7fda700b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.345+0000 7fda89270640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fda700b6480 0x7fda700b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.345+0000 7fda7affd640 1 -- 172.21.15.29:0/1840405712 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fda800e5db0 con 0x7fda84102640 2024-09-21T07:01:10.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.345+0000 7fda89270640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fda700b6480 0x7fda700b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda74009bd0 tx=0x7fda74005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:10.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.348+0000 7fda7affd640 1 -- 172.21.15.29:0/1840405712 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda800b26d0 con 0x7fda84102640 2024-09-21T07:01:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.539+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fda841a4940 con 0x7fda84102640 2024-09-21T07:01:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.545+0000 7fda7affd640 1 -- 172.21.15.29:0/1840405712 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7fda800b7610 con 0x7fda84102640 2024-09-21T07:01:10.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 -- 172.21.15.29:0/892648474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a41068d0 msgr2=0x7f22a4108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/892648474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a41068d0 0x7f22a4108d30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2294009900 tx=0x7f229402a410 comp rx=0 tx=0).stop 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 -- 172.21.15.29:0/892648474 shutdown_connections 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/892648474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a4109470 0x7f22a410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/892648474 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a41068d0 0x7f22a4108d30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/892648474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a406b980 0x7f22a4106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 -- 172.21.15.29:0/892648474 >> 172.21.15.29:0/892648474 conn(0x7f22a40fdfb0 msgr2=0x7f22a4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 -- 172.21.15.29:0/892648474 shutdown_connections 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 -- 172.21.15.29:0/892648474 wait complete. 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.540+0000 7f22a9ed9640 1 Processor -- start 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a9ed9640 1 -- start start 2024-09-21T07:01:10.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a9ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a406b980 0x7f22a41039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a9ed9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a41068d0 0x7f22a4102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a9ed9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a4109470 0x7f22a41027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a9ed9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f22a410f380 con 0x7f22a4109470 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a9ed9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f22a410f200 con 0x7f22a406b980 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a9ed9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f22a410f500 con 0x7f22a41068d0 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a4109470 0x7f22a41027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a41068d0 0x7f22a4102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a41068d0 0x7f22a4102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.29:33560/0 (socket says 172.21.15.29:33560) 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a2ffd640 1 -- 172.21.15.29:0/1152895443 learned_addr learned my addr 172.21.15.29:0/1152895443 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a4109470 0x7f22a41027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54496/0 (socket says 172.21.15.29:54496) 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.541+0000 7f22a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a406b980 0x7f22a41039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.542+0000 7f22a2ffd640 1 -- 172.21.15.29:0/1152895443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a406b980 msgr2=0x7f22a41039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.542+0000 7f22a2ffd640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a406b980 0x7f22a41039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.542+0000 7f22a2ffd640 1 -- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a4109470 msgr2=0x7f22a41027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.542+0000 7f22a2ffd640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a4109470 0x7f22a41027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.542+0000 7f22a2ffd640 1 -- 172.21.15.29:0/1152895443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a4102ed0 con 0x7f22a41068d0 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.542+0000 7f22a2ffd640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a41068d0 0x7f22a4102290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2294006010 tx=0x7f22940042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.545+0000 7f22a0ff9640 1 -- 172.21.15.29:0/1152895443 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229403f030 con 0x7f22a41068d0 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.545+0000 7f22a0ff9640 1 -- 172.21.15.29:0/1152895443 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2294031910 con 0x7f22a41068d0 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.545+0000 7f22a0ff9640 1 -- 172.21.15.29:0/1152895443 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294035070 con 0x7f22a41068d0 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.546+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a41a4010 con 0x7f22a41068d0 2024-09-21T07:01:10.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.546+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a41a43b0 con 0x7f22a41068d0 2024-09-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.547+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a40ffad0 con 0x7f22a41068d0 2024-09-21T07:01:10.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.547+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fda700b6480 msgr2=0x7fda700b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.547+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fda700b6480 0x7fda700b8990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fda74009bd0 tx=0x7fda74005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.547+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 msgr2=0x7fda8419c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.547+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 0x7fda8419c180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda8000e9f0 tx=0x7fda8000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.547+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 shutdown_connections 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fda700b6480 0x7fda700b8990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda84104070 0x7fda8419d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda841036d0 0x7fda8419c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7fda8bcd5640 1 --2- 172.21.15.29:0/1840405712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda84102640 0x7fda8419c180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 >> 172.21.15.29:0/1840405712 conn(0x7fda840fdfb0 msgr2=0x7fda840ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 shutdown_connections 2024-09-21T07:01:10.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7fda8bcd5640 1 -- 172.21.15.29:0/1840405712 wait complete. 2024-09-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.548+0000 7f22a0ff9640 1 -- 172.21.15.29:0/1152895443 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2294042030 con 0x7f22a41068d0 2024-09-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.549+0000 7f22a0ff9640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22900b65d0 0x7f22900b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.549+0000 7f22a37fe640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22900b65d0 0x7f22900b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.549+0000 7f22a0ff9640 1 -- 172.21.15.29:0/1152895443 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2294105a40 con 0x7f22a41068d0 2024-09-21T07:01:10.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.550+0000 7f22a37fe640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22900b65d0 0x7f22900b8ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f228c009bd0 tx=0x7f228c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:10.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.554+0000 7f22a0ff9640 1 -- 172.21.15.29:0/1152895443 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22940d2380 con 0x7f22a41068d0 2024-09-21T07:01:10.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.747+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f22a402e640 con 0x7f22a41068d0 2024-09-21T07:01:10.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.754+0000 7f22a0ff9640 1 -- 172.21.15.29:0/1152895443 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f22940d72c0 con 0x7f22a41068d0 2024-09-21T07:01:10.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22900b65d0 msgr2=0x7f22900b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22900b65d0 0x7f22900b8ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f228c009bd0 tx=0x7f228c005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a41068d0 msgr2=0x7f22a4102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a41068d0 0x7f22a4102290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2294006010 tx=0x7f22940042f0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 shutdown_connections 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22900b65d0 0x7f22900b8ae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22a4109470 0x7f22a41027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a41068d0 0x7f22a4102290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 --2- 172.21.15.29:0/1152895443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a406b980 0x7f22a41039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.756+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 >> 172.21.15.29:0/1152895443 conn(0x7f22a40fdfb0 msgr2=0x7f22a4104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.757+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 shutdown_connections 2024-09-21T07:01:10.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:10.757+0000 7f22a9ed9640 1 -- 172.21.15.29:0/1152895443 wait complete. 2024-09-21T07:01:11.072 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:11.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 -- 172.21.15.29:0/1074421886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870101b00 msgr2=0x7fe870101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:11.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 --2- 172.21.15.29:0/1074421886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870101b00 0x7fe870101f10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009900 tx=0x7fe86c02a410 comp rx=0 tx=0).stop 2024-09-21T07:01:11.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 -- 172.21.15.29:0/1074421886 shutdown_connections 2024-09-21T07:01:11.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 --2- 172.21.15.29:0/1074421886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe870109470 0x7fe87010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 --2- 172.21.15.29:0/1074421886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe870102530 0x7fe870108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 --2- 172.21.15.29:0/1074421886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870101b00 0x7fe870101f10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 -- 172.21.15.29:0/1074421886 >> 172.21.15.29:0/1074421886 conn(0x7fe8700fd770 msgr2=0x7fe8700ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:11.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 -- 172.21.15.29:0/1074421886 shutdown_connections 2024-09-21T07:01:11.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.722+0000 7fe8773b4640 1 -- 172.21.15.29:0/1074421886 wait complete. 2024-09-21T07:01:11.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 Processor -- start 2024-09-21T07:01:11.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 -- start start 2024-09-21T07:01:11.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe870101b00 0x7fe870104290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe870102530 0x7fe870102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870109470 0x7fe8701030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe87010f3c0 con 0x7fe870109470 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe87010f240 con 0x7fe870102530 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe8773b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe87010f540 con 0x7fe870101b00 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe875951640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870109470 0x7fe8701030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe875951640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870109470 0x7fe8701030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54522/0 (socket says 172.21.15.29:54522) 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe875951640 1 -- 172.21.15.29:0/3192503700 learned_addr learned my addr 172.21.15.29:0/3192503700 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe875150640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe870101b00 0x7fe870104290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.723+0000 7fe87494f640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe870102530 0x7fe870102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe875951640 1 -- 172.21.15.29:0/3192503700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe870101b00 msgr2=0x7fe870104290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:11.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe875951640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe870101b00 0x7fe870104290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe875951640 1 -- 172.21.15.29:0/3192503700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe870102530 msgr2=0x7fe870102b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe875951640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe870102530 0x7fe870102b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe875951640 1 -- 172.21.15.29:0/3192503700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8701037a0 con 0x7fe870109470 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe875951640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870109470 0x7fe8701030a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe86800eb10 tx=0x7fe86800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe8667fc640 1 -- 172.21.15.29:0/3192503700 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868004b20 con 0x7fe870109470 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe8667fc640 1 -- 172.21.15.29:0/3192503700 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe868004cc0 con 0x7fe870109470 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8701a4010 con 0x7fe870109470 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe8667fc640 1 -- 172.21.15.29:0/3192503700 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868010670 con 0x7fe870109470 2024-09-21T07:01:11.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.724+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8701a44c0 con 0x7fe870109470 2024-09-21T07:01:11.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.726+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe870101f10 con 0x7fe870109470 2024-09-21T07:01:11.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.727+0000 7fe8667fc640 1 -- 172.21.15.29:0/3192503700 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fe868005020 con 0x7fe870109470 2024-09-21T07:01:11.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.727+0000 7fe8667fc640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe85c0b6500 0x7fe85c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:11.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.728+0000 7fe875150640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe85c0b6500 0x7fe85c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:11.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.728+0000 7fe8667fc640 1 -- 172.21.15.29:0/3192503700 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe8680e5af0 con 0x7fe870109470 2024-09-21T07:01:11.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.728+0000 7fe875150640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe85c0b6500 0x7fe85c0b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe86c004770 tx=0x7fe86c0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:11.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.732+0000 7fe8667fc640 1 -- 172.21.15.29:0/3192503700 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8680ae050 con 0x7fe870109470 2024-09-21T07:01:11.823 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:11 smithi029 ceph-mon[30983]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:11.823 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:11 smithi029 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T07:01:11.823 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:11.823 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:11.823 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:11.823 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:11.823 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:11 smithi029 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T07:01:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:11 smithi066 ceph-mon[34793]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:11 smithi066 ceph-mon[34793]: from='client.? ' entity='client.admin' 2024-09-21T07:01:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:11 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:11 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:11.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:11 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:11.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:11 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:11.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:11 smithi066 ceph-mon[34793]: from='client.? ' entity='client.admin' 2024-09-21T07:01:11.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:11 smithi052 ceph-mon[34308]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:11.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:11 smithi052 ceph-mon[34308]: from='client.? ' entity='client.admin' 2024-09-21T07:01:11.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:11 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:11.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:11 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:11.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:11 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:11.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:11 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:11.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:11 smithi052 ceph-mon[34308]: from='client.? ' entity='client.admin' 2024-09-21T07:01:11.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.924+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fe8700ff290 con 0x7fe870109470 2024-09-21T07:01:11.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.928+0000 7fe8667fc640 1 -- 172.21.15.29:0/3192503700 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v25)=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7fe8680b2430 con 0x7fe870109470 2024-09-21T07:01:11.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe85c0b6500 msgr2=0x7fe85c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:11.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe85c0b6500 0x7fe85c0b8a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe86c004770 tx=0x7fe86c0314a0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870109470 msgr2=0x7fe8701030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:11.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870109470 0x7fe8701030a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe86800eb10 tx=0x7fe86800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 shutdown_connections 2024-09-21T07:01:11.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe85c0b6500 0x7fe85c0b8a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe870109470 0x7fe8701030a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe870102530 0x7fe870102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 --2- 172.21.15.29:0/3192503700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe870101b00 0x7fe870104290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:11.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 >> 172.21.15.29:0/3192503700 conn(0x7fe8700fd770 msgr2=0x7fe870107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:11.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 shutdown_connections 2024-09-21T07:01:11.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:11.930+0000 7fe8773b4640 1 -- 172.21.15.29:0/3192503700 wait complete. 2024-09-21T07:01:12.929 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:12 smithi029 ceph-mon[30983]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:12.929 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:12 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3192503700' entity='client.admin' 2024-09-21T07:01:13.242 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:13.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:12 smithi052 ceph-mon[34308]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:13.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:12 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3192503700' entity='client.admin' 2024-09-21T07:01:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:12 smithi066 ceph-mon[34793]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:12 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3192503700' entity='client.admin' 2024-09-21T07:01:13.695 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi029') 2024-09-21T07:01:13.695 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi029') 2024-09-21T07:01:13.696 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi029') 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 -- 172.21.15.29:0/3177435117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 msgr2=0x7f5068102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 --2- 172.21.15.29:0/3177435117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068102ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5064009900 tx=0x7f506402a480 comp rx=0 tx=0).stop 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 -- 172.21.15.29:0/3177435117 shutdown_connections 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 --2- 172.21.15.29:0/3177435117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5068104070 0x7f506810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 --2- 172.21.15.29:0/3177435117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50681036d0 0x7f5068103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 --2- 172.21.15.29:0/3177435117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068102ab0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 -- 172.21.15.29:0/3177435117 >> 172.21.15.29:0/3177435117 conn(0x7f50680fdfb0 msgr2=0x7f5068100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 -- 172.21.15.29:0/3177435117 shutdown_connections 2024-09-21T07:01:15.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.047+0000 7f506fdc7640 1 -- 172.21.15.29:0/3177435117 wait complete. 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 Processor -- start 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 -- start start 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50681036d0 0x7f506819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5068104070 0x7f506819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f506810e280 con 0x7f5068102640 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f506810e100 con 0x7f50681036d0 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506fdc7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f506810e400 con 0x7f5068104070 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54566/0 (socket says 172.21.15.29:54566) 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 -- 172.21.15.29:0/2293044682 learned_addr learned my addr 172.21.15.29:0/2293044682 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506e364640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5068104070 0x7f506819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506d362640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50681036d0 0x7f506819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 -- 172.21.15.29:0/2293044682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5068104070 msgr2=0x7f506819b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5068104070 0x7f506819b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 -- 172.21.15.29:0/2293044682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50681036d0 msgr2=0x7f506819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50681036d0 0x7f506819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.048+0000 7f506db63640 1 -- 172.21.15.29:0/2293044682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506819ba00 con 0x7f5068102640 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.049+0000 7f506db63640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068199fd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5064006010 tx=0x7f5064004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.049+0000 7f505effd640 1 -- 172.21.15.29:0/2293044682 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506403f030 con 0x7f5068102640 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.049+0000 7f505effd640 1 -- 172.21.15.29:0/2293044682 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5064003cb0 con 0x7f5068102640 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.049+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506819bc90 con 0x7f5068102640 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.049+0000 7f505effd640 1 -- 172.21.15.29:0/2293044682 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064035070 con 0x7f5068102640 2024-09-21T07:01:15.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.049+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50681a23f0 con 0x7f5068102640 2024-09-21T07:01:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.050+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5068102ab0 con 0x7f5068102640 2024-09-21T07:01:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.051+0000 7f505effd640 1 -- 172.21.15.29:0/2293044682 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5064042030 con 0x7f5068102640 2024-09-21T07:01:15.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.052+0000 7f505effd640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50540b6500 0x7f50540b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.052+0000 7f506d362640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50540b6500 0x7f50540b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.052+0000 7f505effd640 1 -- 172.21.15.29:0/2293044682 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5064105bb0 con 0x7f5068102640 2024-09-21T07:01:15.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.053+0000 7f506d362640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50540b6500 0x7f50540b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5058005d00 tx=0x7f505800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:15.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.057+0000 7f505effd640 1 -- 172.21.15.29:0/2293044682 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5064003e60 con 0x7f5068102640 2024-09-21T07:01:15.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:14 smithi029 ceph-mon[30983]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:15.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:14 smithi052 ceph-mon[34308]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:15.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.246+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f50681a2660 con 0x7f5068102640 2024-09-21T07:01:15.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.250+0000 7f505effd640 1 -- 172.21.15.29:0/2293044682 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v26)=0 v26) ==== 116+0+0 (secure 0 0 0) 0x7f50640d24f0 con 0x7f5068102640 2024-09-21T07:01:15.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50540b6500 msgr2=0x7f50540b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50540b6500 0x7f50540b8a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5058005d00 tx=0x7f505800b410 comp rx=0 tx=0).stop 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 msgr2=0x7f5068199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068199fd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5064006010 tx=0x7f5064004340 comp rx=0 tx=0).stop 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 shutdown_connections 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50540b6500 0x7f50540b8a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5068104070 0x7f506819b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50681036d0 0x7f506819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 --2- 172.21.15.29:0/2293044682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5068102640 0x7f5068199fd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 >> 172.21.15.29:0/2293044682 conn(0x7f50680fdfb0 msgr2=0x7f50680ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 shutdown_connections 2024-09-21T07:01:15.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:15.253+0000 7f506fdc7640 1 -- 172.21.15.29:0/2293044682 wait complete. 2024-09-21T07:01:15.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:14 smithi066 ceph-mon[34793]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:16.318 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:16 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2293044682' entity='client.admin' 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 -- 172.21.15.29:0/3147451326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318104800 msgr2=0x7f8318104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 --2- 172.21.15.29:0/3147451326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318104800 0x7f8318104c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f830c009900 tx=0x7f830c02a480 comp rx=0 tx=0).stop 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 -- 172.21.15.29:0/3147451326 shutdown_connections 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 --2- 172.21.15.29:0/3147451326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83181051a0 0x7f831810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 --2- 172.21.15.29:0/3147451326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318104800 0x7f8318104c10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 --2- 172.21.15.29:0/3147451326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8318103770 0x7f8318103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 -- 172.21.15.29:0/3147451326 >> 172.21.15.29:0/3147451326 conn(0x7f83180ff0c0 msgr2=0x7f8318101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:16.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.451+0000 7f831da20640 1 -- 172.21.15.29:0/3147451326 shutdown_connections 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.452+0000 7f831da20640 1 -- 172.21.15.29:0/3147451326 wait complete. 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.452+0000 7f831da20640 1 Processor -- start 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.452+0000 7f831da20640 1 -- start start 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831da20640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318103770 0x7f831819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831da20640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8318104800 0x7f831819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831da20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83181051a0 0x7f831819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831da20640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f831810f3c0 con 0x7f8318103770 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831da20640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f831810f240 con 0x7f8318104800 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831da20640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f831810f540 con 0x7f83181051a0 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318103770 0x7f831819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318103770 0x7f831819c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54548/0 (socket says 172.21.15.29:54548) 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 -- 172.21.15.29:0/4255988777 learned_addr learned my addr 172.21.15.29:0/4255988777 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:16.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f83167fc640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8318104800 0x7f831819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f83177fe640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83181051a0 0x7f831819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 -- 172.21.15.29:0/4255988777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83181051a0 msgr2=0x7f831819d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83181051a0 0x7f831819d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 -- 172.21.15.29:0/4255988777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8318104800 msgr2=0x7f831819c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8318104800 0x7f831819c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 -- 172.21.15.29:0/4255988777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831819dc30 con 0x7f8318103770 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f83167fc640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8318104800 0x7f831819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f8316ffd640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318103770 0x7f831819c200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f830800e9f0 tx=0x7f830800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831ca1e640 1 -- 172.21.15.29:0/4255988777 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830800cd80 con 0x7f8318103770 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831ca1e640 1 -- 172.21.15.29:0/4255988777 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83080054d0 con 0x7f8318103770 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.453+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831819df20 con 0x7f8318103770 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.454+0000 7f831ca1e640 1 -- 172.21.15.29:0/4255988777 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308010690 con 0x7f8318103770 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.454+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83181a4620 con 0x7f8318103770 2024-09-21T07:01:16.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.455+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83181a47f0 con 0x7f8318103770 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.456+0000 7f831ca1e640 1 -- 172.21.15.29:0/4255988777 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f8308004e30 con 0x7f8318103770 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.457+0000 7f831ca1e640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f83000b6580 0x7f83000b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.457+0000 7f83167fc640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f83000b6580 0x7f83000b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.457+0000 7f831ca1e640 1 -- 172.21.15.29:0/4255988777 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f83080e5d90 con 0x7f8318103770 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.458+0000 7f83167fc640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f83000b6580 0x7f83000b8a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f830c031440 tx=0x7f830c005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.460+0000 7f831ca1e640 1 -- 172.21.15.29:0/4255988777 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8308056710 con 0x7f8318103770 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.648+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f83181a49c0 con 0x7f8318103770 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.648+0000 7f831ca1e640 1 -- 172.21.15.29:0/4255988777 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v25)=0 v25) ==== 106+0+0 (secure 0 0 0) 0x7f83080ae250 con 0x7f8318103770 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f83000b6580 msgr2=0x7f83000b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f83000b6580 0x7f83000b8a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f830c031440 tx=0x7f830c005d50 comp rx=0 tx=0).stop 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318103770 msgr2=0x7f831819c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318103770 0x7f831819c200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f830800e9f0 tx=0x7f830800edf0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 shutdown_connections 2024-09-21T07:01:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f83000b6580 0x7f83000b8a90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83181051a0 0x7f831819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8318104800 0x7f831819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 --2- 172.21.15.29:0/4255988777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8318103770 0x7f831819c200 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 >> 172.21.15.29:0/4255988777 conn(0x7f83180ff0c0 msgr2=0x7f83180755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 shutdown_connections 2024-09-21T07:01:16.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:14.651+0000 7f831da20640 1 -- 172.21.15.29:0/4255988777 wait complete. 2024-09-21T07:01:16.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:16 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2293044682' entity='client.admin' 2024-09-21T07:01:16.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:16 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2293044682' entity='client.admin' 2024-09-21T07:01:17.544 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:17 smithi029 ceph-mon[30983]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:17.545 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:17 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2754195779' entity='client.admin' 2024-09-21T07:01:17.545 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:17 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4255963304' entity='client.admin' 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 -- 172.21.15.29:0/3378881741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440105750 msgr2=0x7f1440107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 --2- 172.21.15.29:0/3378881741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440105750 0x7f1440107c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1434009860 tx=0x7f143402a340 comp rx=0 tx=0).stop 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 -- 172.21.15.29:0/3378881741 shutdown_connections 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 --2- 172.21.15.29:0/3378881741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440108370 0x7f144010a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 --2- 172.21.15.29:0/3378881741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440105750 0x7f1440107c30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 --2- 172.21.15.29:0/3378881741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1440102c90 0x7f1440105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 -- 172.21.15.29:0/3378881741 >> 172.21.15.29:0/3378881741 conn(0x7f14400fd770 msgr2=0x7f14400ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 -- 172.21.15.29:0/3378881741 shutdown_connections 2024-09-21T07:01:17.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.555+0000 7f1445a79640 1 -- 172.21.15.29:0/3378881741 wait complete. 2024-09-21T07:01:17.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.556+0000 7f1445a79640 1 Processor -- start 2024-09-21T07:01:17.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.556+0000 7f1445a79640 1 -- start start 2024-09-21T07:01:17.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.556+0000 7f1445a79640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440102c90 0x7f14401021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.556+0000 7f1445a79640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440105750 0x7f144019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.556+0000 7f1445a79640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1440108370 0x7f14401a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f1445a79640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f144010e260 con 0x7f1440105750 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f1445a79640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f144010e0e0 con 0x7f1440108370 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f1445a79640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f144010e3e0 con 0x7f1440102c90 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440105750 0x7f144019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440105750 0x7f144019ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41956/0 (socket says 172.21.15.29:41956) 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 -- 172.21.15.29:0/645112355 learned_addr learned my addr 172.21.15.29:0/645112355 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143f7fe640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440102c90 0x7f14401021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143ffff640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1440108370 0x7f14401a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 -- 172.21.15.29:0/645112355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440102c90 msgr2=0x7f14401021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440102c90 0x7f14401021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 -- 172.21.15.29:0/645112355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1440108370 msgr2=0x7f14401a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1440108370 0x7f14401a1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 -- 172.21.15.29:0/645112355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14401a1a80 con 0x7f1440105750 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143f7fe640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440102c90 0x7f14401021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143effd640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440105750 0x7f144019ed30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1434032d50 tx=0x7f1434032d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143cff9640 1 -- 172.21.15.29:0/645112355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434037040 con 0x7f1440105750 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.557+0000 7f143cff9640 1 -- 172.21.15.29:0/645112355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1434030c90 con 0x7f1440105750 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.558+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14401a1d10 con 0x7f1440105750 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.558+0000 7f143cff9640 1 -- 172.21.15.29:0/645112355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434003850 con 0x7f1440105750 2024-09-21T07:01:17.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.558+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14401a2190 con 0x7f1440105750 2024-09-21T07:01:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.559+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14401a2360 con 0x7f1440105750 2024-09-21T07:01:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.560+0000 7f143cff9640 1 -- 172.21.15.29:0/645112355 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1434043020 con 0x7f1440105750 2024-09-21T07:01:17.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.561+0000 7f143cff9640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f14280b6500 0x7f14280b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.561+0000 7f143f7fe640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f14280b6500 0x7f14280b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.561+0000 7f143cff9640 1 -- 172.21.15.29:0/645112355 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1434104e90 con 0x7f1440105750 2024-09-21T07:01:17.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.561+0000 7f143f7fe640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f14280b6500 0x7f14280b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f143000bfd0 tx=0x7f143000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:17.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.564+0000 7f143cff9640 1 -- 172.21.15.29:0/645112355 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f143404a020 con 0x7f1440105750 2024-09-21T07:01:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:17 smithi052 ceph-mon[34308]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:17 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2754195779' entity='client.admin' 2024-09-21T07:01:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:17 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4255963304' entity='client.admin' 2024-09-21T07:01:17.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.752+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f14401a26a0 con 0x7f1440105750 2024-09-21T07:01:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 -- 172.21.15.29:0/3155045927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 msgr2=0x7f5b181063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/3155045927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b181063f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c009900 tx=0x7f5b0c02a410 comp rx=0 tx=0).stop 2024-09-21T07:01:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 -- 172.21.15.29:0/3155045927 shutdown_connections 2024-09-21T07:01:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/3155045927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b18109470 0x7f5b1810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/3155045927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b18106930 0x7f5b18108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/3155045927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b181063f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 -- 172.21.15.29:0/3155045927 >> 172.21.15.29:0/3155045927 conn(0x7f5b180fdfb0 msgr2=0x7f5b18100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 -- 172.21.15.29:0/3155045927 shutdown_connections 2024-09-21T07:01:17.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.755+0000 7f5b1f08a640 1 -- 172.21.15.29:0/3155045927 wait complete. 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 Processor -- start 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 -- start start 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b18103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b18106930 0x7f5b181022f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b18109470 0x7f5b18102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1810f350 con 0x7f5b1806b920 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1810f1d0 con 0x7f5b18106930 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1f08a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1810f4d0 con 0x7f5b18109470 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1ce26640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b18103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1ce26640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b18103a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41972/0 (socket says 172.21.15.29:41972) 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1ce26640 1 -- 172.21.15.29:0/2456073649 learned_addr learned my addr 172.21.15.29:0/2456073649 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:17.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b17fff640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b18106930 0x7f5b181022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.756+0000 7f5b1d627640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b18109470 0x7f5b18102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f5b1ce26640 1 -- 172.21.15.29:0/2456073649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b18109470 msgr2=0x7f5b18102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f5b1ce26640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b18109470 0x7f5b18102830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f5b1ce26640 1 -- 172.21.15.29:0/2456073649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b18106930 msgr2=0x7f5b181022f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f5b1ce26640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b18106930 0x7f5b181022f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f5b1ce26640 1 -- 172.21.15.29:0/2456073649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b18102f30 con 0x7f5b1806b920 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f5b17fff640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b18106930 0x7f5b181022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f5b1ce26640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b18103a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c006010 tx=0x7f5b0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:17.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.757+0000 7f143cff9640 1 -- 172.21.15.29:0/645112355 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v29)=0 v29) ==== 106+0+0 (secure 0 0 0) 0x7f14340cd470 con 0x7f1440105750 2024-09-21T07:01:17.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.759+0000 7f5b15ffb640 1 -- 172.21.15.29:0/2456073649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c03f030 con 0x7f5b1806b920 2024-09-21T07:01:17.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.759+0000 7f5b15ffb640 1 -- 172.21.15.29:0/2456073649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b0c031910 con 0x7f5b1806b920 2024-09-21T07:01:17.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.759+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b181a4030 con 0x7f5b1806b920 2024-09-21T07:01:17.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.759+0000 7f5b15ffb640 1 -- 172.21.15.29:0/2456073649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c035070 con 0x7f5b1806b920 2024-09-21T07:01:17.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.759+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b181a4420 con 0x7f5b1806b920 2024-09-21T07:01:17.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f14280b6500 msgr2=0x7f14280b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f14280b6500 0x7f14280b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f143000bfd0 tx=0x7f143000b390 comp rx=0 tx=0).stop 2024-09-21T07:01:17.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440105750 msgr2=0x7f144019ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440105750 0x7f144019ed30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1434032d50 tx=0x7f1434032d80 comp rx=0 tx=0).stop 2024-09-21T07:01:17.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 shutdown_connections 2024-09-21T07:01:17.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f14280b6500 0x7f14280b8a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1440108370 0x7f14401a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440105750 0x7f144019ed30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 --2- 172.21.15.29:0/645112355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1440102c90 0x7f14401021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 >> 172.21.15.29:0/645112355 conn(0x7f14400fd770 msgr2=0x7f1440103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:17.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 shutdown_connections 2024-09-21T07:01:17.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f1445a79640 1 -- 172.21.15.29:0/645112355 wait complete. 2024-09-21T07:01:17.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.760+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b18106d40 con 0x7f5b1806b920 2024-09-21T07:01:17.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.762+0000 7f5b15ffb640 1 -- 172.21.15.29:0/2456073649 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f5b0c042030 con 0x7f5b1806b920 2024-09-21T07:01:17.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.763+0000 7f5b15ffb640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5b080b6500 0x7f5b080b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.763+0000 7f5b17fff640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5b080b6500 0x7f5b080b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.763+0000 7f5b15ffb640 1 -- 172.21.15.29:0/2456073649 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5b0c105b30 con 0x7f5b1806b920 2024-09-21T07:01:17.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.763+0000 7f5b17fff640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5b080b6500 0x7f5b080b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fc0 tx=0x7f5b04005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:17.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.771+0000 7f5b15ffb640 1 -- 172.21.15.29:0/2456073649 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b0c0d23d0 con 0x7f5b1806b920 2024-09-21T07:01:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:17 smithi066 ceph-mon[34793]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:17 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2754195779' entity='client.admin' 2024-09-21T07:01:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:17 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4255963304' entity='client.admin' 2024-09-21T07:01:17.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.962+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f5b180ffad0 con 0x7f5b1806b920 2024-09-21T07:01:17.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.966+0000 7f5b15ffb640 1 -- 172.21.15.29:0/2456073649 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v30)=0 v30) ==== 117+0+0 (secure 0 0 0) 0x7f5b0c0d7310 con 0x7f5b1806b920 2024-09-21T07:01:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5b080b6500 msgr2=0x7f5b080b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5b080b6500 0x7f5b080b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009fc0 tx=0x7f5b04005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 msgr2=0x7f5b18103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b18103a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c006010 tx=0x7f5b0c0042f0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 shutdown_connections 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f5b080b6500 0x7f5b080b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b18109470 0x7f5b18102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5b18106930 0x7f5b181022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 --2- 172.21.15.29:0/2456073649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b1806b920 0x7f5b18103a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 >> 172.21.15.29:0/2456073649 conn(0x7f5b180fdfb0 msgr2=0x7f5b18104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.968+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 shutdown_connections 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.969+0000 7f5b1f08a640 1 -- 172.21.15.29:0/2456073649 wait complete. 2024-09-21T07:01:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 -- 172.21.15.29:0/1773687613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 msgr2=0x7f495010ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 --2- 172.21.15.29:0/1773687613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495010ba00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4948009ca0 tx=0x7f494802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 -- 172.21.15.29:0/1773687613 shutdown_connections 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 --2- 172.21.15.29:0/1773687613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495010ba00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 --2- 172.21.15.29:0/1773687613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4950101e20 0x7f49501090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 --2- 172.21.15.29:0/1773687613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49501014d0 0x7f49501018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 -- 172.21.15.29:0/1773687613 >> 172.21.15.29:0/1773687613 conn(0x7f49500fd310 msgr2=0x7f49500ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 -- 172.21.15.29:0/1773687613 shutdown_connections 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.286+0000 7f4955e4d640 1 -- 172.21.15.29:0/1773687613 wait complete. 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.287+0000 7f4955e4d640 1 Processor -- start 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.287+0000 7f4955e4d640 1 -- start start 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f4955e4d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49501014d0 0x7f4950199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f4955e4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4950101e20 0x7f495019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f4955e4d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f4955e4d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f495010f380 con 0x7f49501095e0 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f4955e4d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f495010f200 con 0x7f49501014d0 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f4955e4d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f495010f500 con 0x7f4950101e20 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495019b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54596/0 (socket says 172.21.15.29:54596) 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 -- 172.21.15.29:0/2754195779 learned_addr learned my addr 172.21.15.29:0/2754195779 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494f7fe640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49501014d0 0x7f4950199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494effd640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4950101e20 0x7f495019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 -- 172.21.15.29:0/2754195779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4950101e20 msgr2=0x7f495019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4950101e20 0x7f495019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 -- 172.21.15.29:0/2754195779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49501014d0 msgr2=0x7f4950199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49501014d0 0x7f4950199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 -- 172.21.15.29:0/2754195779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495019b980 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.288+0000 7f494ffff640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495019b160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f49480097b0 tx=0x7f4948031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.289+0000 7f494cff9640 1 -- 172.21.15.29:0/2754195779 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948003bf0 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.289+0000 7f494cff9640 1 -- 172.21.15.29:0/2754195779 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4948003d90 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.289+0000 7f494cff9640 1 -- 172.21.15.29:0/2754195779 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494802fc30 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.289+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495019bc10 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.289+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49501a2370 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.290+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4950107eb0 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.291+0000 7f494cff9640 1 -- 172.21.15.29:0/2754195779 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f4948004040 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.292+0000 7f494cff9640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f49380b6580 0x7f49380b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.292+0000 7f494f7fe640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f49380b6580 0x7f49380b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.292+0000 7f494cff9640 1 -- 172.21.15.29:0/2754195779 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4948106a00 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.292+0000 7f494f7fe640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f49380b6580 0x7f49380b8a90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4940009bd0 tx=0x7f4940005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.296+0000 7f494cff9640 1 -- 172.21.15.29:0/2754195779 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49480ceec0 con 0x7f49501095e0 2024-09-21T07:01:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.487+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f495002e640 con 0x7f49501095e0 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.491+0000 7f494cff9640 1 -- 172.21.15.29:0/2754195779 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v27)=0 v27) ==== 127+0+0 (secure 0 0 0) 0x7f49480d32a0 con 0x7f49501095e0 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f49380b6580 msgr2=0x7f49380b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f49380b6580 0x7f49380b8a90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4940009bd0 tx=0x7f4940005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 msgr2=0x7f495019b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495019b160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f49480097b0 tx=0x7f4948031840 comp rx=0 tx=0).stop 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 shutdown_connections 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f49380b6580 0x7f49380b8a90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49501095e0 0x7f495019b160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4950101e20 0x7f495019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 --2- 172.21.15.29:0/2754195779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49501014d0 0x7f4950199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 >> 172.21.15.29:0/2754195779 conn(0x7f49500fd310 msgr2=0x7f4950105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 shutdown_connections 2024-09-21T07:01:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:16.494+0000 7f4955e4d640 1 -- 172.21.15.29:0/2754195779 wait complete. 2024-09-21T07:01:19.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:18 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/645112355' entity='client.admin' 2024-09-21T07:01:19.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:18 smithi066 ceph-mon[34793]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:19.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:18 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2456073649' entity='client.admin' 2024-09-21T07:01:19.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:18 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/645112355' entity='client.admin' 2024-09-21T07:01:19.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:18 smithi029 ceph-mon[30983]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:19.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:18 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2456073649' entity='client.admin' 2024-09-21T07:01:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:18 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/645112355' entity='client.admin' 2024-09-21T07:01:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:18 smithi052 ceph-mon[34308]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:18 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2456073649' entity='client.admin' 2024-09-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 -- 172.21.15.29:0/148351848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3181094a0 msgr2=0x7fb31810b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 --2- 172.21.15.29:0/148351848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3181094a0 0x7fb31810b9b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb310009900 tx=0x7fb31002a410 comp rx=0 tx=0).stop 2024-09-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 -- 172.21.15.29:0/148351848 shutdown_connections 2024-09-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 --2- 172.21.15.29:0/148351848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3181094a0 0x7fb31810b9b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 --2- 172.21.15.29:0/148351848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb318106900 0x7fb318108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 --2- 172.21.15.29:0/148351848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb31806c340 0x7fb3181063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 -- 172.21.15.29:0/148351848 >> 172.21.15.29:0/148351848 conn(0x7fb3180fdfe0 msgr2=0x7fb318100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 -- 172.21.15.29:0/148351848 shutdown_connections 2024-09-21T07:01:19.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.363+0000 7fb31df63640 1 -- 172.21.15.29:0/148351848 wait complete. 2024-09-21T07:01:19.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.364+0000 7fb31df63640 1 Processor -- start 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.364+0000 7fb31df63640 1 -- start start 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.364+0000 7fb31df63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806c340 0x7fb318199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.364+0000 7fb31df63640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318106900 0x7fb31819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.364+0000 7fb31df63640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3181094a0 0x7fb31819b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb31df63640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb31810f3c0 con 0x7fb318106900 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb31df63640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb31810f240 con 0x7fb31806c340 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb31df63640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb31810f540 con 0x7fb3181094a0 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318106900 0x7fb31819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb3177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806c340 0x7fb318199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318106900 0x7fb31819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41988/0 (socket says 172.21.15.29:41988) 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 -- 172.21.15.29:0/2471030574 learned_addr learned my addr 172.21.15.29:0/2471030574 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:19.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb317fff640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3181094a0 0x7fb31819b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 -- 172.21.15.29:0/2471030574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3181094a0 msgr2=0x7fb31819b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3181094a0 0x7fb31819b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 -- 172.21.15.29:0/2471030574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806c340 msgr2=0x7fb318199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806c340 0x7fb318199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 -- 172.21.15.29:0/2471030574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31819b960 con 0x7fb318106900 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb3177fe640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806c340 0x7fb318199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb316ffd640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318106900 0x7fb31819a5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e9f0 tx=0x7fb30000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.365+0000 7fb314ff9640 1 -- 172.21.15.29:0/2471030574 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30000cd80 con 0x7fb318106900 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.366+0000 7fb314ff9640 1 -- 172.21.15.29:0/2471030574 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3000108e0 con 0x7fb318106900 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.366+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31819bc50 con 0x7fb318106900 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.366+0000 7fb314ff9640 1 -- 172.21.15.29:0/2471030574 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300018980 con 0x7fb318106900 2024-09-21T07:01:19.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.366+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3181a2350 con 0x7fb318106900 2024-09-21T07:01:19.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.367+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3180ffb00 con 0x7fb318106900 2024-09-21T07:01:19.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.368+0000 7fb314ff9640 1 -- 172.21.15.29:0/2471030574 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fb300010430 con 0x7fb318106900 2024-09-21T07:01:19.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.369+0000 7fb314ff9640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb3040b6500 0x7fb3040b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:19.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.369+0000 7fb3177fe640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb3040b6500 0x7fb3040b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:19.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.369+0000 7fb314ff9640 1 -- 172.21.15.29:0/2471030574 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb3000e5df0 con 0x7fb318106900 2024-09-21T07:01:19.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.370+0000 7fb3177fe640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb3040b6500 0x7fb3040b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb308005fd0 tx=0x7fb308009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:19.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.372+0000 7fb314ff9640 1 -- 172.21.15.29:0/2471030574 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3000b2690 con 0x7fb318106900 2024-09-21T07:01:19.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.561+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fb31802e640 con 0x7fb318106900 2024-09-21T07:01:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.561+0000 7fb314ff9640 1 -- 172.21.15.29:0/2471030574 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7fb3000b75d0 con 0x7fb318106900 2024-09-21T07:01:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb3040b6500 msgr2=0x7fb3040b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb3040b6500 0x7fb3040b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb308005fd0 tx=0x7fb308009500 comp rx=0 tx=0).stop 2024-09-21T07:01:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318106900 msgr2=0x7fb31819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318106900 0x7fb31819a5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e9f0 tx=0x7fb30000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 shutdown_connections 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb3040b6500 0x7fb3040b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3181094a0 0x7fb31819b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb318106900 0x7fb31819a5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 --2- 172.21.15.29:0/2471030574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb31806c340 0x7fb318199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 >> 172.21.15.29:0/2471030574 conn(0x7fb3180fdfe0 msgr2=0x7fb318104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 shutdown_connections 2024-09-21T07:01:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:19.563+0000 7fb31df63640 1 -- 172.21.15.29:0/2471030574 wait complete. 2024-09-21T07:01:20.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 -- 172.21.15.29:0/4061423525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a8102690 msgr2=0x7f39a8102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 --2- 172.21.15.29:0/4061423525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a8102690 0x7f39a8102b00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009900 tx=0x7f39a002a480 comp rx=0 tx=0).stop 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 -- 172.21.15.29:0/4061423525 shutdown_connections 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 --2- 172.21.15.29:0/4061423525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39a81040c0 0x7f39a810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 --2- 172.21.15.29:0/4061423525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a8103720 0x7f39a8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 --2- 172.21.15.29:0/4061423525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a8102690 0x7f39a8102b00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 -- 172.21.15.29:0/4061423525 >> 172.21.15.29:0/4061423525 conn(0x7f39a80fe000 msgr2=0x7f39a81004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 -- 172.21.15.29:0/4061423525 shutdown_connections 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 -- 172.21.15.29:0/4061423525 wait complete. 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 Processor -- start 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.081+0000 7f39af714640 1 -- start start 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39af714640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a8102690 0x7f39a806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39af714640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39a8103720 0x7f39a81a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39af714640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a81040c0 0x7f39a81a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39af714640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f39a810e2b0 con 0x7f39a81040c0 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39af714640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39a810e130 con 0x7f39a8103720 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39af714640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39a810e430 con 0x7f39a8102690 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a81040c0 0x7f39a81a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a81040c0 0x7f39a81a3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54604/0 (socket says 172.21.15.29:54604) 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 -- 172.21.15.29:0/4255963304 learned_addr learned my addr 172.21.15.29:0/4255963304 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39ad4b0640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a8102690 0x7f39a806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39accaf640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39a8103720 0x7f39a81a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 -- 172.21.15.29:0/4255963304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a8102690 msgr2=0x7f39a806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a8102690 0x7f39a806bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 -- 172.21.15.29:0/4255963304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39a8103720 msgr2=0x7f39a81a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39a8103720 0x7f39a81a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 -- 172.21.15.29:0/4255963304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a81a3b90 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39accaf640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39a8103720 0x7f39a81a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39adcb1640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a81040c0 0x7f39a81a3620 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f399800cce0 tx=0x7f399800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.082+0000 7f39a67fc640 1 -- 172.21.15.29:0/4255963304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399800f450 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.083+0000 7f39a67fc640 1 -- 172.21.15.29:0/4255963304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f399800faa0 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.083+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a81a3e80 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.083+0000 7f39a67fc640 1 -- 172.21.15.29:0/4255963304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998018b70 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.083+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a81a42e0 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.084+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a8109870 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.086+0000 7f39a67fc640 1 -- 172.21.15.29:0/4255963304 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f3998018d10 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.087+0000 7f39a67fc640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f39900b6500 0x7f39900b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.087+0000 7f39ad4b0640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f39900b6500 0x7f39900b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.087+0000 7f39a67fc640 1 -- 172.21.15.29:0/4255963304 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f39980e5b90 con 0x7f39a81040c0 2024-09-21T07:01:20.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.088+0000 7f39ad4b0640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f39900b6500 0x7f39900b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39a0031440 tx=0x7f39a00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.090+0000 7f39a67fc640 1 -- 172.21.15.29:0/4255963304 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3998014030 con 0x7f39a81040c0 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.283+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f39a802e640 con 0x7f39a81040c0 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.288+0000 7f39a67fc640 1 -- 172.21.15.29:0/4255963304 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7f39980ae1e0 con 0x7f39a81040c0 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.290+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f39900b6500 msgr2=0x7f39900b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.290+0000 7f39af714640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f39900b6500 0x7f39900b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39a0031440 tx=0x7f39a00314a0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.290+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a81040c0 msgr2=0x7f39a81a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.290+0000 7f39af714640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a81040c0 0x7f39a81a3620 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f399800cce0 tx=0x7f399800a620 comp rx=0 tx=0).stop 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.290+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 shutdown_connections 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.290+0000 7f39af714640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f39900b6500 0x7f39900b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.291+0000 7f39af714640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39a81040c0 0x7f39a81a3620 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.291+0000 7f39af714640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39a8103720 0x7f39a81a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.291+0000 7f39af714640 1 --2- 172.21.15.29:0/4255963304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a8102690 0x7f39a806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.291+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 >> 172.21.15.29:0/4255963304 conn(0x7f39a80fe000 msgr2=0x7f39a8106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:20.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.291+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 shutdown_connections 2024-09-21T07:01:20.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:17.291+0000 7f39af714640 1 -- 172.21.15.29:0/4255963304 wait complete. 2024-09-21T07:01:21.004 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:20 smithi029 ceph-mon[30983]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:21.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:20 smithi052 ceph-mon[34308]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:20 smithi066 ceph-mon[34793]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:22.338 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi029') 2024-09-21T07:01:22.339 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi029') 2024-09-21T07:01:22.339 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi029') 2024-09-21T07:01:22.339 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi029') 2024-09-21T07:01:22.339 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi029') 2024-09-21T07:01:22.339 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi029') 2024-09-21T07:01:22.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 -- 172.21.15.29:0/4127399203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a01047e0 msgr2=0x7f73a0104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 --2- 172.21.15.29:0/4127399203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a01047e0 0x7f73a0104bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7394009900 tx=0x7f739402a480 comp rx=0 tx=0).stop 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 -- 172.21.15.29:0/4127399203 shutdown_connections 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 --2- 172.21.15.29:0/4127399203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a0105180 0x7f73a010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 --2- 172.21.15.29:0/4127399203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a01047e0 0x7f73a0104bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 --2- 172.21.15.29:0/4127399203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73a0103750 0x7f73a0103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 -- 172.21.15.29:0/4127399203 >> 172.21.15.29:0/4127399203 conn(0x7f73a00ff0c0 msgr2=0x7f73a0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 -- 172.21.15.29:0/4127399203 shutdown_connections 2024-09-21T07:01:23.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.861+0000 7f73a5482640 1 -- 172.21.15.29:0/4127399203 wait complete. 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 Processor -- start 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 -- start start 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a0103750 0x7f73a019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a01047e0 0x7f73a019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73a0105180 0x7f73a019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f73a010f3a0 con 0x7f73a0103750 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73a010f220 con 0x7f73a0105180 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f73a5482640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f73a010f520 con 0x7f73a01047e0 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.862+0000 7f739effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a0103750 0x7f73a019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a0103750 0x7f73a019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42010/0 (socket says 172.21.15.29:42010) 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 -- 172.21.15.29:0/1192332809 learned_addr learned my addr 172.21.15.29:0/1192332809 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:23.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739f7fe640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73a0105180 0x7f73a019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739e7fc640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a01047e0 0x7f73a019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 -- 172.21.15.29:0/1192332809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a01047e0 msgr2=0x7f73a019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a01047e0 0x7f73a019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 -- 172.21.15.29:0/1192332809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73a0105180 msgr2=0x7f73a019b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73a0105180 0x7f73a019b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 -- 172.21.15.29:0/1192332809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a019b9a0 con 0x7f73a0103750 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f739effd640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a0103750 0x7f73a019a000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f739000c920 tx=0x7f739000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f7387fff640 1 -- 172.21.15.29:0/1192332809 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390007c70 con 0x7f73a0103750 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f7387fff640 1 -- 172.21.15.29:0/1192332809 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7390007e10 con 0x7f73a0103750 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f7387fff640 1 -- 172.21.15.29:0/1192332809 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390018820 con 0x7f73a0103750 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a019bc90 con 0x7f73a0103750 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.863+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a01a2250 con 0x7f73a0103750 2024-09-21T07:01:23.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.864+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a010a910 con 0x7f73a0103750 2024-09-21T07:01:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.866+0000 7f7387fff640 1 -- 172.21.15.29:0/1192332809 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f739000f450 con 0x7f73a0103750 2024-09-21T07:01:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.867+0000 7f7387fff640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f73880b6500 0x7f73880b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.867+0000 7f739e7fc640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f73880b6500 0x7f73880b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.867+0000 7f7387fff640 1 -- 172.21.15.29:0/1192332809 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f73900e5950 con 0x7f73a0103750 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.868+0000 7f739e7fc640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f73880b6500 0x7f73880b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7394031440 tx=0x7f73940314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:22.870+0000 7f7387fff640 1 -- 172.21.15.29:0/1192332809 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7390014030 con 0x7f73a0103750 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.059+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f73a002e640 con 0x7f73a0103750 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.063+0000 7f7387fff640 1 -- 172.21.15.29:0/1192332809 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v31)=0 v31) ==== 115+0+0 (secure 0 0 0) 0x7f73900adfc0 con 0x7f73a0103750 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.065+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f73880b6500 msgr2=0x7f73880b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.065+0000 7f73a5482640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f73880b6500 0x7f73880b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7394031440 tx=0x7f73940314a0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.065+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a0103750 msgr2=0x7f73a019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.065+0000 7f73a5482640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a0103750 0x7f73a019a000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f739000c920 tx=0x7f739000cde0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 shutdown_connections 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f73880b6500 0x7f73880b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73a0105180 0x7f73a019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a01047e0 0x7f73a019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 --2- 172.21.15.29:0/1192332809 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73a0103750 0x7f73a019a000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 >> 172.21.15.29:0/1192332809 conn(0x7f73a00ff0c0 msgr2=0x7f73a0107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 shutdown_connections 2024-09-21T07:01:23.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:23.066+0000 7f73a5482640 1 -- 172.21.15.29:0/1192332809 wait complete. 2024-09-21T07:01:23.207 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:22 smithi029 ceph-mon[30983]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:23.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:22 smithi052 ceph-mon[34308]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:23.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:22 smithi066 ceph-mon[34793]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:23.827 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi029') 2024-09-21T07:01:23.827 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi029') 2024-09-21T07:01:24.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 -- 172.21.15.29:0/2441527043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec1068d0 msgr2=0x7fdcec108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 --2- 172.21.15.29:0/2441527043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec1068d0 0x7fdcec108d30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009900 tx=0x7fdcdc02a410 comp rx=0 tx=0).stop 2024-09-21T07:01:24.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 -- 172.21.15.29:0/2441527043 shutdown_connections 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 --2- 172.21.15.29:0/2441527043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcec109470 0x7fdcec10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 --2- 172.21.15.29:0/2441527043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec1068d0 0x7fdcec108d30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 --2- 172.21.15.29:0/2441527043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcec06b980 0x7fdcec106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 -- 172.21.15.29:0/2441527043 >> 172.21.15.29:0/2441527043 conn(0x7fdcec0fdfb0 msgr2=0x7fdcec100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 -- 172.21.15.29:0/2441527043 shutdown_connections 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.161+0000 7fdcf448c640 1 -- 172.21.15.29:0/2441527043 wait complete. 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 Processor -- start 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 -- start start 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec06b980 0x7fdcec199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcec1068d0 0x7fdcec19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcec109470 0x7fdcec19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec10f360 con 0x7fdcec06b980 2024-09-21T07:01:24.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec10f1e0 con 0x7fdcec1068d0 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf448c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdcec10f4e0 con 0x7fdcec109470 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf2228640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec06b980 0x7fdcec199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf2228640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec06b980 0x7fdcec199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42040/0 (socket says 172.21.15.29:42040) 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf2228640 1 -- 172.21.15.29:0/993621574 learned_addr learned my addr 172.21.15.29:0/993621574 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf2a29640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcec109470 0x7fdcec19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.162+0000 7fdcf1a27640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcec1068d0 0x7fdcec19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf2228640 1 -- 172.21.15.29:0/993621574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcec109470 msgr2=0x7fdcec19b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf2228640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcec109470 0x7fdcec19b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf2228640 1 -- 172.21.15.29:0/993621574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcec1068d0 msgr2=0x7fdcec19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf2228640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcec1068d0 0x7fdcec19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf2228640 1 -- 172.21.15.29:0/993621574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcec19b9b0 con 0x7fdcec06b980 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf2228640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec06b980 0x7fdcec199f80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdce800d950 tx=0x7fdce800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdce37fe640 1 -- 172.21.15.29:0/993621574 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce8017070 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdce37fe640 1 -- 172.21.15.29:0/993621574 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdce8009c30 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcec19bca0 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdce37fe640 1 -- 172.21.15.29:0/993621574 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce800f620 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.163+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcec1a23a0 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.164+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcec0ffad0 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.166+0000 7fdce37fe640 1 -- 172.21.15.29:0/993621574 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fdce8010460 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.167+0000 7fdce37fe640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdcd80b6480 0x7fdcd80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.167+0000 7fdcf1a27640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdcd80b6480 0x7fdcd80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.167+0000 7fdce37fe640 1 -- 172.21.15.29:0/993621574 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdce80e5260 con 0x7fdcec06b980 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.167+0000 7fdcf1a27640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdcd80b6480 0x7fdcd80b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc031440 tx=0x7fdcdc0314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.170+0000 7fdce37fe640 1 -- 172.21.15.29:0/993621574 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdce80ad7c0 con 0x7fdcec06b980 2024-09-21T07:01:24.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 -- 172.21.15.29:0/3072340530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6624102e50 msgr2=0x7f6624103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 --2- 172.21.15.29:0/3072340530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6624102e50 0x7f6624103260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6610009900 tx=0x7f661002a480 comp rx=0 tx=0).stop 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 -- 172.21.15.29:0/3072340530 shutdown_connections 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 --2- 172.21.15.29:0/3072340530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66241037f0 0x7f662410a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 --2- 172.21.15.29:0/3072340530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6624102e50 0x7f6624103260 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 --2- 172.21.15.29:0/3072340530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6624101dc0 0x7f6624102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 -- 172.21.15.29:0/3072340530 >> 172.21.15.29:0/3072340530 conn(0x7f66240fd770 msgr2=0x7f66240ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 -- 172.21.15.29:0/3072340530 shutdown_connections 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.071+0000 7f662ac46640 1 -- 172.21.15.29:0/3072340530 wait complete. 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 Processor -- start 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 -- start start 2024-09-21T07:01:24.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6624101dc0 0x7f662410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6624102e50 0x7f662410bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66241037f0 0x7f662410c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f662410f380 con 0x7f66241037f0 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f662410f200 con 0x7f6624101dc0 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f662ac46640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f662410f500 con 0x7f6624102e50 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f66291e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66241037f0 0x7f662410c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f66291e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66241037f0 0x7f662410c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42020/0 (socket says 172.21.15.29:42020) 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f66291e3640 1 -- 172.21.15.29:0/1710885582 learned_addr learned my addr 172.21.15.29:0/1710885582 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f6623fff640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6624102e50 0x7f662410bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.072+0000 7f66289e2640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6624101dc0 0x7f662410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f66291e3640 1 -- 172.21.15.29:0/1710885582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6624102e50 msgr2=0x7f662410bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f66291e3640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6624102e50 0x7f662410bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f66291e3640 1 -- 172.21.15.29:0/1710885582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6624101dc0 msgr2=0x7f662410d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f66291e3640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6624101dc0 0x7f662410d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f66291e3640 1 -- 172.21.15.29:0/1710885582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662410cb20 con 0x7f66241037f0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f6623fff640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6624102e50 0x7f662410bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f66291e3640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66241037f0 0x7f662410c420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f661c009fd0 tx=0x7f661c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f6621ffb640 1 -- 172.21.15.29:0/1710885582 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c017070 con 0x7f66241037f0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f6621ffb640 1 -- 172.21.15.29:0/1710885582 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f661c003e20 con 0x7f66241037f0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66241a4060 con 0x7f66241037f0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f6621ffb640 1 -- 172.21.15.29:0/1710885582 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c010460 con 0x7f66241037f0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.073+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a44c0 con 0x7f66241037f0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.074+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6624108f80 con 0x7f66241037f0 2024-09-21T07:01:24.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.076+0000 7f6621ffb640 1 -- 172.21.15.29:0/1710885582 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f661c003970 con 0x7f66241037f0 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.077+0000 7f6621ffb640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f66140b6480 0x7f66140b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.077+0000 7f6621ffb640 1 -- 172.21.15.29:0/1710885582 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f661c0e5350 con 0x7f66241037f0 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.077+0000 7f66289e2640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f66140b6480 0x7f66140b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.077+0000 7f66289e2640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f66140b6480 0x7f66140b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6618009bd0 tx=0x7f6618005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.080+0000 7f6621ffb640 1 -- 172.21.15.29:0/1710885582 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f661c0b1bf0 con 0x7f66241037f0 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.271+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f662402e640 con 0x7f66241037f0 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.276+0000 7f6621ffb640 1 -- 172.21.15.29:0/1710885582 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f661c0b6b30 con 0x7f66241037f0 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f66140b6480 msgr2=0x7f66140b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f66140b6480 0x7f66140b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6618009bd0 tx=0x7f6618005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66241037f0 msgr2=0x7f662410c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66241037f0 0x7f662410c420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f661c009fd0 tx=0x7f661c00b260 comp rx=0 tx=0).stop 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 shutdown_connections 2024-09-21T07:01:24.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f66140b6480 0x7f66140b8990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66241037f0 0x7f662410c420 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6624102e50 0x7f662410bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 --2- 172.21.15.29:0/1710885582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6624101dc0 0x7f662410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 >> 172.21.15.29:0/1710885582 conn(0x7f66240fd770 msgr2=0x7f6624106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 shutdown_connections 2024-09-21T07:01:24.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.278+0000 7f662ac46640 1 -- 172.21.15.29:0/1710885582 wait complete. 2024-09-21T07:01:24.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:24 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1192332809' entity='client.admin' 2024-09-21T07:01:24.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.368+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fdcec02e640 con 0x7fdcec06b980 2024-09-21T07:01:24.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:24 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1192332809' entity='client.admin' 2024-09-21T07:01:24.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.372+0000 7fdce37fe640 1 -- 172.21.15.29:0/993621574 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7fdce8009de0 con 0x7fdcec06b980 2024-09-21T07:01:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdcd80b6480 msgr2=0x7fdcd80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdcd80b6480 0x7fdcd80b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc031440 tx=0x7fdcdc0314a0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec06b980 msgr2=0x7fdcec199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec06b980 0x7fdcec199f80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdce800d950 tx=0x7fdce800de10 comp rx=0 tx=0).stop 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 shutdown_connections 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdcd80b6480 0x7fdcd80b8990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcec109470 0x7fdcec19b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcec1068d0 0x7fdcec19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 --2- 172.21.15.29:0/993621574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdcec06b980 0x7fdcec199f80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 >> 172.21.15.29:0/993621574 conn(0x7fdcec0fdfb0 msgr2=0x7fdcec104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 shutdown_connections 2024-09-21T07:01:24.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:24.375+0000 7fdcf448c640 1 -- 172.21.15.29:0/993621574 wait complete. 2024-09-21T07:01:24.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:24 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1192332809' entity='client.admin' 2024-09-21T07:01:25.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:25 smithi029 ceph-mon[30983]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:25.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:25 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1710885582' entity='client.admin' 2024-09-21T07:01:25.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:25 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/993621574' entity='client.admin' 2024-09-21T07:01:25.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:25 smithi066 ceph-mon[34793]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:25.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:25 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1710885582' entity='client.admin' 2024-09-21T07:01:25.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:25 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/993621574' entity='client.admin' 2024-09-21T07:01:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:25 smithi052 ceph-mon[34308]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:25 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1710885582' entity='client.admin' 2024-09-21T07:01:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:25 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/993621574' entity='client.admin' 2024-09-21T07:01:25.895 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.895 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.895 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.895 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.895 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.896 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.896 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.896 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.896 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.896 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.896 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'd3a42dd8-77e6-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi029') 2024-09-21T07:01:25.896 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T07:01:26.157 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:26.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.606+0000 7fc0c73c4640 1 -- 172.21.15.29:0/3246656498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c01047e0 msgr2=0x7fc0c0104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.606+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/3246656498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c01047e0 0x7fc0c0104bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009900 tx=0x7fc0b002a480 comp rx=0 tx=0).stop 2024-09-21T07:01:26.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.606+0000 7fc0c73c4640 1 -- 172.21.15.29:0/3246656498 shutdown_connections 2024-09-21T07:01:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.606+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/3246656498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0c0105180 0x7fc0c010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.606+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/3246656498 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c01047e0 0x7fc0c0104bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.606+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/3246656498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0103750 0x7fc0c0103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.606+0000 7fc0c73c4640 1 -- 172.21.15.29:0/3246656498 >> 172.21.15.29:0/3246656498 conn(0x7fc0c00ff0c0 msgr2=0x7fc0c0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.607+0000 7fc0c73c4640 1 -- 172.21.15.29:0/3246656498 shutdown_connections 2024-09-21T07:01:26.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.607+0000 7fc0c73c4640 1 -- 172.21.15.29:0/3246656498 wait complete. 2024-09-21T07:01:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.607+0000 7fc0c73c4640 1 Processor -- start 2024-09-21T07:01:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.607+0000 7fc0c73c4640 1 -- start start 2024-09-21T07:01:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c73c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0103750 0x7fc0c0199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c73c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0c01047e0 0x7fc0c019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c73c4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c0105180 0x7fc0c019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c73c4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c010f3a0 con 0x7fc0c0105180 2024-09-21T07:01:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c73c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c010f220 con 0x7fc0c0103750 2024-09-21T07:01:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c73c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c010f520 con 0x7fc0c01047e0 2024-09-21T07:01:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c0105180 0x7fc0c019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c0105180 0x7fc0c019b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42058/0 (socket says 172.21.15.29:42058) 2024-09-21T07:01:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 -- 172.21.15.29:0/4115071966 learned_addr learned my addr 172.21.15.29:0/4115071966 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c495f640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0c01047e0 0x7fc0c019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5160640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0103750 0x7fc0c0199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 -- 172.21.15.29:0/4115071966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0c01047e0 msgr2=0x7fc0c019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0c01047e0 0x7fc0c019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 -- 172.21.15.29:0/4115071966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0103750 msgr2=0x7fc0c0199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0103750 0x7fc0c0199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 -- 172.21.15.29:0/4115071966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c019b9f0 con 0x7fc0c0105180 2024-09-21T07:01:26.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c5961640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c0105180 0x7fc0c019b1d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800eb10 tx=0x7fc0b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0b67fc640 1 -- 172.21.15.29:0/4115071966 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8004b20 con 0x7fc0c0105180 2024-09-21T07:01:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0b67fc640 1 -- 172.21.15.29:0/4115071966 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b8004cc0 con 0x7fc0c0105180 2024-09-21T07:01:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c019bce0 con 0x7fc0c0105180 2024-09-21T07:01:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.608+0000 7fc0b67fc640 1 -- 172.21.15.29:0/4115071966 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8010670 con 0x7fc0c0105180 2024-09-21T07:01:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.609+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c01a23e0 con 0x7fc0c0105180 2024-09-21T07:01:26.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.610+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c010a910 con 0x7fc0c0105180 2024-09-21T07:01:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.611+0000 7fc0b67fc640 1 -- 172.21.15.29:0/4115071966 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fc0b8005020 con 0x7fc0c0105180 2024-09-21T07:01:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.612+0000 7fc0b67fc640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0ac0b6480 0x7fc0ac0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.612+0000 7fc0c5160640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0ac0b6480 0x7fc0ac0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.612+0000 7fc0b67fc640 1 -- 172.21.15.29:0/4115071966 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc0b80e5c10 con 0x7fc0c0105180 2024-09-21T07:01:26.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.612+0000 7fc0c5160640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0ac0b6480 0x7fc0ac0b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc005fd0 tx=0x7fc0bc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.618+0000 7fc0b67fc640 1 -- 172.21.15.29:0/4115071966 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0b80ae170 con 0x7fc0c0105180 2024-09-21T07:01:26.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.811+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc0c002e640 con 0x7fc0c0105180 2024-09-21T07:01:26.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.812+0000 7fc0b67fc640 1 -- 172.21.15.29:0/4115071966 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21315 (secure 0 0 0) 0x7fc0b80b2550 con 0x7fc0c0105180 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global dev auth_debug true 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global basic log_to_file true 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global basic log_to_journald false 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global basic log_to_stderr false 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_allow_pool_delete true 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T07:01:26.814 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global dev ms_die_on_bug true 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global dev ms_die_on_old_message true 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global dev ms_die_on_skipped_message false 2024-09-21T07:01:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced debug_mon 20/20 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced debug_ms 1/1 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced debug_paxos 20/20 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T07:01:26.816 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced debug_client 20/20 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T07:01:26.817 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev bdev_debug_aio true 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced bdev_enable_discard true 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced debug_bluefs 1/20 2024-09-21T07:01:26.818 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced debug_bluestore 1/20 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced debug_ms 1/1 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced debug_osd 20/20 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev osd_debug_op_order true 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev osd_debug_shutdown true 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T07:01:26.819 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced debug_mds 20/20 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced debug_ms 2/2 2024-09-21T07:01:26.820 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced mds_bal_split_size 100 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds dev mds_debug_frag true 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds dev mds_verify_scatter true 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:client advanced client_mount_timeout 600 2024-09-21T07:01:26.821 INFO:teuthology.orchestra.run.smithi029.stdout:client advanced debug_client 20/20 2024-09-21T07:01:26.822 INFO:teuthology.orchestra.run.smithi029.stdout:client advanced debug_ms 1/1 2024-09-21T07:01:26.822 INFO:teuthology.orchestra.run.smithi029.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:01:26.822 INFO:teuthology.orchestra.run.smithi029.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:01:26.822 INFO:teuthology.orchestra.run.smithi029.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T07:01:26.822 INFO:teuthology.orchestra.run.smithi029.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T07:01:26.822 INFO:teuthology.orchestra.run.smithi029.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0ac0b6480 msgr2=0x7fc0ac0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0ac0b6480 0x7fc0ac0b8990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc005fd0 tx=0x7fc0bc005850 comp rx=0 tx=0).stop 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c0105180 msgr2=0x7fc0c019b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c0105180 0x7fc0c019b1d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800eb10 tx=0x7fc0b800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 shutdown_connections 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0ac0b6480 0x7fc0ac0b8990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0c0105180 0x7fc0c019b1d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0c01047e0 0x7fc0c019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 --2- 172.21.15.29:0/4115071966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0c0103750 0x7fc0c0199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 >> 172.21.15.29:0/4115071966 conn(0x7fc0c00ff0c0 msgr2=0x7fc0c0107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:26.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 shutdown_connections 2024-09-21T07:01:26.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:26.814+0000 7fc0c73c4640 1 -- 172.21.15.29:0/4115071966 wait complete. 2024-09-21T07:01:27.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:27 smithi029 ceph-mon[30983]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:27.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:27 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4115071966' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:01:27.591 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T07:01:27.591 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:01:27.591 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:01:27.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:27 smithi066 ceph-mon[34793]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:27.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:27 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4115071966' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:01:27.609 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:01:27.609 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 07:00:09.051622033 +0000 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 06:55:23.892042667 +0000 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 06:55:23.892042667 +0000 2024-09-21T07:01:27.667 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 06:55:23.892042667 +0000 2024-09-21T07:01:27.667 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:01:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T07:01:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T07:01:27.734 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000102477 s, 5.0 MB/s 2024-09-21T07:01:27.736 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:01:27.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:27 smithi052 ceph-mon[34308]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:27 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4115071966' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T07:01:27.793 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-09-21T07:01:27.850 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:01:27.850 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:27.851 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T07:01:27.851 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:27.851 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:27.851 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 07:00:09.085621484 +0000 2024-09-21T07:01:27.851 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 06:55:24.209037553 +0000 2024-09-21T07:01:27.851 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 06:55:24.209037553 +0000 2024-09-21T07:01:27.851 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 06:55:24.209037553 +0000 2024-09-21T07:01:27.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:01:27.916 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T07:01:27.916 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T07:01:27.916 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.8158e-05 s, 5.2 MB/s 2024-09-21T07:01:27.917 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:01:27.975 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-09-21T07:01:28.030 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 07:00:09.123620871 +0000 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 06:55:24.525032455 +0000 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 06:55:24.525032455 +0000 2024-09-21T07:01:28.031 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 06:55:24.525032455 +0000 2024-09-21T07:01:28.031 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:01:28.095 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T07:01:28.095 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T07:01:28.095 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000108502 s, 4.7 MB/s 2024-09-21T07:01:28.097 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:01:28.154 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-09-21T07:01:28.210 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 07:00:09.166620176 +0000 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 06:55:24.838027406 +0000 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 06:55:24.838027406 +0000 2024-09-21T07:01:28.211 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 06:55:24.838027406 +0000 2024-09-21T07:01:28.211 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:01:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-21T07:01:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-21T07:01:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000106955 s, 4.8 MB/s 2024-09-21T07:01:28.276 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:01:28.333 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-21T07:01:28.333 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:01:28.353 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:01:28.353 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-21T07:01:28.411 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:01:28.411 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:28.411 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T07:01:28.411 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:28.411 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:28.411 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-21 07:00:58.871388174 +0000 2024-09-21T07:01:28.412 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-21 06:55:30.198628689 +0000 2024-09-21T07:01:28.412 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-21 06:55:30.198628689 +0000 2024-09-21T07:01:28.412 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-21 06:55:30.198628689 +0000 2024-09-21T07:01:28.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:01:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-21T07:01:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-21T07:01:28.482 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000131391 s, 3.9 MB/s 2024-09-21T07:01:28.483 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:01:28.542 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-21 07:00:58.872388163 +0000 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-21 06:55:30.529624793 +0000 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-21 06:55:30.529624793 +0000 2024-09-21T07:01:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-21 06:55:30.529624793 +0000 2024-09-21T07:01:28.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:01:28.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-21T07:01:28.665 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-21T07:01:28.666 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000119834 s, 4.3 MB/s 2024-09-21T07:01:28.667 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:01:28.724 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-21T07:01:28.781 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-21 07:00:58.872388163 +0000 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-21 06:55:30.839621143 +0000 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-21 06:55:30.839621143 +0000 2024-09-21T07:01:28.782 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-21 06:55:30.839621143 +0000 2024-09-21T07:01:28.782 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:01:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-21T07:01:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-21T07:01:28.847 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000117061 s, 4.4 MB/s 2024-09-21T07:01:28.848 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:01:28.905 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-21 07:00:58.872388163 +0000 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-21 06:55:31.158617388 +0000 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-21 06:55:31.158617388 +0000 2024-09-21T07:01:28.962 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-21 06:55:31.158617388 +0000 2024-09-21T07:01:28.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:01:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-21T07:01:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-21T07:01:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000111818 s, 4.6 MB/s 2024-09-21T07:01:29.028 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:01:29.084 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-21T07:01:29.084 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T07:01:29.105 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T07:01:29.105 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-09-21T07:01:29.164 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T07:01:29.164 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:29.165 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T07:01:29.165 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:29.165 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:29.165 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-21 07:00:56.559794665 +0000 2024-09-21T07:01:29.165 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-21 06:55:39.864292392 +0000 2024-09-21T07:01:29.165 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-21 06:55:39.864292392 +0000 2024-09-21T07:01:29.165 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-21 06:55:39.864292392 +0000 2024-09-21T07:01:29.165 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T07:01:29.236 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-21T07:01:29.236 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-21T07:01:29.236 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000273221 s, 1.9 MB/s 2024-09-21T07:01:29.237 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T07:01:29.297 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-09-21T07:01:29.355 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T07:01:29.355 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:29.355 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T07:01:29.356 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:29.356 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:29.356 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-21 07:00:56.560794656 +0000 2024-09-21T07:01:29.356 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-21 06:55:40.192289435 +0000 2024-09-21T07:01:29.356 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-21 06:55:40.192289435 +0000 2024-09-21T07:01:29.356 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-21 06:55:40.192289435 +0000 2024-09-21T07:01:29.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T07:01:29.422 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-21T07:01:29.422 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-21T07:01:29.422 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000193579 s, 2.6 MB/s 2024-09-21T07:01:29.423 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T07:01:29.481 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-21 07:00:56.560794656 +0000 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-21 06:55:40.519286488 +0000 2024-09-21T07:01:29.539 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-21 06:55:40.519286488 +0000 2024-09-21T07:01:29.540 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-21 06:55:40.519286488 +0000 2024-09-21T07:01:29.540 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T07:01:29.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:29 smithi066 ceph-mon[34793]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:29.604 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-21T07:01:29.605 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-21T07:01:29.605 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000205372 s, 2.5 MB/s 2024-09-21T07:01:29.606 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T07:01:29.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:29 smithi029 ceph-mon[30983]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:29.664 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-21 07:00:56.561794647 +0000 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-21 06:55:40.859283423 +0000 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-21 06:55:40.859283423 +0000 2024-09-21T07:01:29.721 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-21 06:55:40.859283423 +0000 2024-09-21T07:01:29.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T07:01:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:29 smithi052 ceph-mon[34308]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:29.786 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-21T07:01:29.786 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-21T07:01:29.787 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000197842 s, 2.6 MB/s 2024-09-21T07:01:29.788 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T07:01:29.845 INFO:tasks.cephadm:Deploying osd.0 on smithi029 with /dev/vg_nvme/lv_4... 2024-09-21T07:01:29.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:01:30.109 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:31.557 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:31 smithi029 ceph-mon[30983]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:31.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:31 smithi066 ceph-mon[34793]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:31 smithi052 ceph-mon[34308]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:32.729 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:01:32.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi029:vg_nvme/lv_4 2024-09-21T07:01:33.010 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:01:33.385 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:33 smithi029 ceph-mon[30983]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 -- 172.21.15.29:0/972454784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc1036d0 msgr2=0x7fb9cc103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 --2- 172.21.15.29:0/972454784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc1036d0 0x7fb9cc103ae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009900 tx=0x7fb9bc02a480 comp rx=0 tx=0).stop 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 -- 172.21.15.29:0/972454784 shutdown_connections 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 --2- 172.21.15.29:0/972454784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9cc104070 0x7fb9cc10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 --2- 172.21.15.29:0/972454784 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc1036d0 0x7fb9cc103ae0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 --2- 172.21.15.29:0/972454784 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9cc102640 0x7fb9cc102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 -- 172.21.15.29:0/972454784 >> 172.21.15.29:0/972454784 conn(0x7fb9cc0fdfb0 msgr2=0x7fb9cc100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:33.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 -- 172.21.15.29:0/972454784 shutdown_connections 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.479+0000 7fb9d4737640 1 -- 172.21.15.29:0/972454784 wait complete. 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 Processor -- start 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 -- start start 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc102640 0x7fb9cc06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9cc1036d0 0x7fb9cc19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9cc104070 0x7fb9cc1a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc10e290 con 0x7fb9cc102640 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc10e110 con 0x7fb9cc1036d0 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d4737640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc10e410 con 0x7fb9cc104070 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d24d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc102640 0x7fb9cc06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d24d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc102640 0x7fb9cc06b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41494/0 (socket says 172.21.15.29:41494) 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.480+0000 7fb9d24d3640 1 -- 172.21.15.29:0/108107790 learned_addr learned my addr 172.21.15.29:0/108107790 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d1cd2640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9cc1036d0 0x7fb9cc19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d2cd4640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9cc104070 0x7fb9cc1a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:33.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d24d3640 1 -- 172.21.15.29:0/108107790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9cc104070 msgr2=0x7fb9cc1a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d24d3640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9cc104070 0x7fb9cc1a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d24d3640 1 -- 172.21.15.29:0/108107790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9cc1036d0 msgr2=0x7fb9cc19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d24d3640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9cc1036d0 0x7fb9cc19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d24d3640 1 -- 172.21.15.29:0/108107790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc1a1ac0 con 0x7fb9cc102640 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d24d3640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc102640 0x7fb9cc06b6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c970 tx=0x7fb9c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9c37fe640 1 -- 172.21.15.29:0/108107790 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8007bb0 con 0x7fb9cc102640 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9cc1a1db0 con 0x7fb9cc102640 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9c37fe640 1 -- 172.21.15.29:0/108107790 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c8007d50 con 0x7fb9cc102640 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9c37fe640 1 -- 172.21.15.29:0/108107790 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800f450 con 0x7fb9cc102640 2024-09-21T07:01:33.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.481+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9cc1a2210 con 0x7fb9cc102640 2024-09-21T07:01:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.482+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9cc109820 con 0x7fb9cc102640 2024-09-21T07:01:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.484+0000 7fb9c37fe640 1 -- 172.21.15.29:0/108107790 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fb9c8005020 con 0x7fb9cc102640 2024-09-21T07:01:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.485+0000 7fb9c37fe640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb9b80b6480 0x7fb9b80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.485+0000 7fb9d1cd2640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb9b80b6480 0x7fb9b80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:33.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.485+0000 7fb9c37fe640 1 -- 172.21.15.29:0/108107790 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb9c80e5740 con 0x7fb9cc102640 2024-09-21T07:01:33.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.485+0000 7fb9d1cd2640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb9b80b6480 0x7fb9b80b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc000c00 tx=0x7fb9bc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:33.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.488+0000 7fb9c37fe640 1 -- 172.21.15.29:0/108107790 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb9c8014030 con 0x7fb9cc102640 2024-09-21T07:01:33.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:33 smithi066 ceph-mon[34793]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:33.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:33.687+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb9cc063800 con 0x7fb9b80b6480 2024-09-21T07:01:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:33 smithi052 ceph-mon[34308]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:34.324 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:34 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:34.324 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:34 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:34.324 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:34 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:34.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:34 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:01:34.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:34 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:01:34.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:34 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:35.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:35 smithi029 ceph-mon[30983]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:35.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:35 smithi029 ceph-mon[30983]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:35.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:35 smithi066 ceph-mon[34793]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:35.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:35 smithi066 ceph-mon[34793]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:35 smithi052 ceph-mon[34308]: from='client.14394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:01:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:35 smithi052 ceph-mon[34308]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:36 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/865871969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e7c8389-ee51-4f2c-802c-d0b9be785e91"} : dispatch 2024-09-21T07:01:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:36 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/865871969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e7c8389-ee51-4f2c-802c-d0b9be785e91"}]': finished 2024-09-21T07:01:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:36 smithi066 ceph-mon[34793]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T07:01:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:01:36.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:36 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/865871969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e7c8389-ee51-4f2c-802c-d0b9be785e91"} : dispatch 2024-09-21T07:01:36.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:36 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/865871969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e7c8389-ee51-4f2c-802c-d0b9be785e91"}]': finished 2024-09-21T07:01:36.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:36 smithi029 ceph-mon[30983]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T07:01:36.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:01:36.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:36 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/865871969' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7e7c8389-ee51-4f2c-802c-d0b9be785e91"} : dispatch 2024-09-21T07:01:36.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:36 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/865871969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e7c8389-ee51-4f2c-802c-d0b9be785e91"}]': finished 2024-09-21T07:01:36.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:36 smithi052 ceph-mon[34308]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T07:01:36.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:01:37.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:37 smithi066 ceph-mon[34793]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:37.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:37 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/393421850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:37 smithi029 ceph-mon[30983]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:37 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/393421850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:37 smithi052 ceph-mon[34308]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:37 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/393421850' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:01:39.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:39 smithi066 ceph-mon[34793]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:39.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:39 smithi029 ceph-mon[30983]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:39.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:39 smithi052 ceph-mon[34308]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:41.535 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:41 smithi029 ceph-mon[30983]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:41.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:41 smithi066 ceph-mon[34793]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:41 smithi052 ceph-mon[34308]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:43.536 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:43 smithi029 ceph-mon[30983]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:43 smithi066 ceph-mon[34793]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:43 smithi052 ceph-mon[34308]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:45.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:45 smithi066 ceph-mon[34793]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:45.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:45 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:01:45.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:45 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:45.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:45 smithi066 ceph-mon[34793]: Deploying daemon osd.0 on smithi029 2024-09-21T07:01:45.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:45 smithi029 ceph-mon[30983]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:45.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:45 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:01:45.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:45 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:45.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:45 smithi029 ceph-mon[30983]: Deploying daemon osd.0 on smithi029 2024-09-21T07:01:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:45 smithi052 ceph-mon[34308]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:45 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T07:01:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:45 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:45 smithi052 ceph-mon[34308]: Deploying daemon osd.0 on smithi029 2024-09-21T07:01:47.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:47 smithi066 ceph-mon[34793]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:47.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:47 smithi029 ceph-mon[30983]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:47.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:47 smithi052 ceph-mon[34308]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:49.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:49 smithi066 ceph-mon[34793]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:49 smithi029 ceph-mon[30983]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:49.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:49 smithi052 ceph-mon[34308]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:51.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:51 smithi066 ceph-mon[34793]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:51.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:51 smithi029 ceph-mon[30983]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:51.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:51 smithi052 ceph-mon[34308]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:52.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:52.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:52.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:52.620 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:52.620 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:52.620 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:52.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:52.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:52.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:53 smithi029 ceph-mon[30983]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:53 smithi052 ceph-mon[34308]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:53 smithi066 ceph-mon[34793]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:55.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:55 smithi029 ceph-mon[30983]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:55.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:55.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:55.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:55 smithi052 ceph-mon[34308]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:55.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:55.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:55.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:55 smithi066 ceph-mon[34793]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:01:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:01:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:56.086 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 0 on host 'smithi029' 2024-09-21T07:01:56.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.083+0000 7fb9c37fe640 1 -- 172.21.15.29:0/108107790 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb9cc063800 con 0x7fb9b80b6480 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb9b80b6480 msgr2=0x7fb9b80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb9b80b6480 0x7fb9b80b8990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc000c00 tx=0x7fb9bc031400 comp rx=0 tx=0).stop 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc102640 msgr2=0x7fb9cc06b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc102640 0x7fb9cc06b6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c970 tx=0x7fb9c800ce30 comp rx=0 tx=0).stop 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 shutdown_connections 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb9b80b6480 0x7fb9b80b8990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9cc104070 0x7fb9cc1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb9cc1036d0 0x7fb9cc19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:56.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 --2- 172.21.15.29:0/108107790 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9cc102640 0x7fb9cc06b6a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:56.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 >> 172.21.15.29:0/108107790 conn(0x7fb9cc0fdfb0 msgr2=0x7fb9cc1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:56.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 shutdown_connections 2024-09-21T07:01:56.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:01:56.086+0000 7fb9d4737640 1 -- 172.21.15.29:0/108107790 wait complete. 2024-09-21T07:01:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:56.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:56.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:56.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:56.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:01:56.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:56.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:01:56.838 DEBUG:teuthology.orchestra.run.smithi029:osd.0> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T07:01:56.840 INFO:tasks.cephadm:Deploying osd.1 on smithi052 with /dev/vg_nvme/lv_4... 2024-09-21T07:01:56.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:01:57.096 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:01:57.321 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:57 smithi029 ceph-mon[30983]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:57.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:57 smithi052 ceph-mon[34308]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:57.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:57 smithi066 ceph-mon[34793]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:57.621 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:01:57 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0[44430]: 2024-09-21T07:01:57.470+0000 7f2aa6d83640 -1 osd.0 0 log_to_monitors true 2024-09-21T07:01:58.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:58 smithi029 ceph-mon[30983]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:01:58.449 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:58 smithi052 ceph-mon[34308]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:01:58.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:58 smithi066 ceph-mon[34793]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T07:01:59.283 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:59 smithi029 ceph-mon[30983]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:59.283 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:59 smithi029 ceph-mon[30983]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:01:59.283 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:59 smithi029 ceph-mon[30983]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:01:59.283 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:59 smithi029 ceph-mon[30983]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:01:59.283 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:01:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:01:59.291 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:59 smithi052 ceph-mon[34308]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:59.291 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:59 smithi052 ceph-mon[34308]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:01:59.291 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:59 smithi052 ceph-mon[34308]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:01:59.291 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:59 smithi052 ceph-mon[34308]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:01:59.291 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:01:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:01:59.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:59 smithi066 ceph-mon[34793]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:01:59.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:59 smithi066 ceph-mon[34793]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T07:01:59.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:59 smithi066 ceph-mon[34793]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T07:01:59.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:59 smithi066 ceph-mon[34793]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:01:59.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:01:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:01:59.792 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T07:01:59.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi052:vg_nvme/lv_4 2024-09-21T07:02:00.068 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:02:00.371 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:01:59 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0[44430]: 2024-09-21T07:01:59.924+0000 7f2aa2d05640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:02:00.371 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:01:59 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0[44430]: 2024-09-21T07:01:59.928+0000 7f2a9aafb640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi029 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi029 to 17092M 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:00.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:00.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:00 smithi029 ceph-mon[30983]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi029 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi029 to 17092M 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.393 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:00.394 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:00.394 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.394 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:00 smithi052 ceph-mon[34308]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' 2024-09-21T07:02:00.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/3743170353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 msgr2=0x7f8e28108d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:00.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/3743170353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e28108d70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009900 tx=0x7f8e1c02a410 comp rx=0 tx=0).stop 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/3743170353 shutdown_connections 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/3743170353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e281094b0 0x7f8e2810b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/3743170353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e28108d70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/3743170353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2806c6a0 0x7f8e281063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/3743170353 >> 172.21.15.52:0/3743170353 conn(0x7f8e280fdff0 msgr2=0x7f8e281004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/3743170353 shutdown_connections 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.484+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/3743170353 wait complete. 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.485+0000 7f8e2dd5c640 1 Processor -- start 2024-09-21T07:02:00.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.485+0000 7f8e2dd5c640 1 -- start start 2024-09-21T07:02:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e2dd5c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e2806c6a0 0x7f8e2819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e2dd5c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e2819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e2dd5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e281094b0 0x7f8e2819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e2dd5c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2810f420 con 0x7f8e281094b0 2024-09-21T07:02:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e2dd5c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2810f2a0 con 0x7f8e28106910 2024-09-21T07:02:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e2dd5c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2810f5a0 con 0x7f8e2806c6a0 2024-09-21T07:02:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e2819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e2819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44684/0 (socket says 172.21.15.52:44684) 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 -- 172.21.15.52:0/1212509401 learned_addr learned my addr 172.21.15.52:0/1212509401 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e27fff640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e281094b0 0x7f8e2819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e277fe640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e2806c6a0 0x7f8e2819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 -- 172.21.15.52:0/1212509401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e2806c6a0 msgr2=0x7f8e2819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e2806c6a0 0x7f8e2819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 -- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e281094b0 msgr2=0x7f8e2819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e281094b0 0x7f8e2819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 -- 172.21.15.52:0/1212509401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2819ba50 con 0x7f8e28106910 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.486+0000 7f8e26ffd640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e2819a690 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c006010 tx=0x7f8e1c004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.487+0000 7f8e24ff9640 1 -- 172.21.15.52:0/1212509401 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c03f030 con 0x7f8e28106910 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.487+0000 7f8e24ff9640 1 -- 172.21.15.52:0/1212509401 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e1c003cb0 con 0x7f8e28106910 2024-09-21T07:02:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.487+0000 7f8e24ff9640 1 -- 172.21.15.52:0/1212509401 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c035070 con 0x7f8e28106910 2024-09-21T07:02:00.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.487+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2819bce0 con 0x7f8e28106910 2024-09-21T07:02:00.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.487+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e281a22f0 con 0x7f8e28106910 2024-09-21T07:02:00.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.488+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e280ffb10 con 0x7f8e28106910 2024-09-21T07:02:00.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.489+0000 7f8e24ff9640 1 -- 172.21.15.52:0/1212509401 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f8e1c042030 con 0x7f8e28106910 2024-09-21T07:02:00.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.490+0000 7f8e24ff9640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8e100b6480 0x7f8e100b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:00.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.490+0000 7f8e24ff9640 1 -- 172.21.15.52:0/1212509401 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f8e1c106430 con 0x7f8e28106910 2024-09-21T07:02:00.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.490+0000 7f8e277fe640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8e100b6480 0x7f8e100b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:00.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.491+0000 7f8e277fe640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8e100b6480 0x7f8e100b8990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800bbe0 tx=0x7f8e1800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:00.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.493+0000 7f8e24ff9640 1 -- 172.21.15.52:0/1212509401 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e1c003e60 con 0x7f8e28106910 2024-09-21T07:02:00.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:02:00.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T07:02:00.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi029 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi029 to 17092M 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:00.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:00 smithi066 ceph-mon[34793]: from='osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457]' entity='osd.0' 2024-09-21T07:02:00.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:00.689+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8e28063800 con 0x7f8e100b6480 2024-09-21T07:02:01.395 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] boot 2024-09-21T07:02:01.396 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T07:02:01.397 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:02:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:02:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:02:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:01.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] boot 2024-09-21T07:02:01.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T07:02:01.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:01.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: osd.0 [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] boot 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T07:02:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T07:02:02.341 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:02 smithi052 ceph-mon[34308]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:02.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:02 smithi066 ceph-mon[34793]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:02 smithi029 ceph-mon[30983]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:03 smithi052 ceph-mon[34308]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:03 smithi052 ceph-mon[34308]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:02:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:03 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/2466912766' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"} : dispatch 2024-09-21T07:02:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:03 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"} : dispatch 2024-09-21T07:02:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:03 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"}]': finished 2024-09-21T07:02:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:03 smithi052 ceph-mon[34308]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T07:02:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:03 smithi066 ceph-mon[34793]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:03 smithi066 ceph-mon[34793]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:02:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:03 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/2466912766' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"} : dispatch 2024-09-21T07:02:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:03 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"} : dispatch 2024-09-21T07:02:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:03 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"}]': finished 2024-09-21T07:02:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:03 smithi066 ceph-mon[34793]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T07:02:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:03 smithi029 ceph-mon[30983]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:03 smithi029 ceph-mon[30983]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T07:02:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:03 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/2466912766' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"} : dispatch 2024-09-21T07:02:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:03 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"} : dispatch 2024-09-21T07:02:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:03 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5beaa28d-3076-4361-8a0a-026ee6e24cd2"}]': finished 2024-09-21T07:02:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:03 smithi029 ceph-mon[30983]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T07:02:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:04.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:04 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/2422068882' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:04.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:04 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/2422068882' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:04.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:04 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/2422068882' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:05.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:05 smithi052 ceph-mon[34308]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:05.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:05 smithi066 ceph-mon[34793]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:05.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:05 smithi029 ceph-mon[30983]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:07.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:07 smithi052 ceph-mon[34308]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:07 smithi066 ceph-mon[34793]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:07.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:07 smithi029 ceph-mon[30983]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:09.417 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:09 smithi066 ceph-mon[34793]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:09 smithi052 ceph-mon[34308]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:09.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:09 smithi029 ceph-mon[30983]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:11.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:11 smithi052 ceph-mon[34308]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:11.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:11 smithi066 ceph-mon[34793]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:11.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:11 smithi029 ceph-mon[30983]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:12.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:02:12.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:12.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:12 smithi052 ceph-mon[34308]: Deploying daemon osd.1 on smithi052 2024-09-21T07:02:12.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:02:12.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:12.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:12 smithi066 ceph-mon[34793]: Deploying daemon osd.1 on smithi052 2024-09-21T07:02:12.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T07:02:12.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:12.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:12 smithi029 ceph-mon[30983]: Deploying daemon osd.1 on smithi052 2024-09-21T07:02:13.290 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:13 smithi052 ceph-mon[34308]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:13.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:13 smithi066 ceph-mon[34793]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:13.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:13 smithi029 ceph-mon[30983]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:15 smithi052 ceph-mon[34308]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:15 smithi066 ceph-mon[34793]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:15.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:15 smithi029 ceph-mon[30983]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:17.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:17 smithi052 ceph-mon[34308]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:17 smithi066 ceph-mon[34793]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:17.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:17 smithi029 ceph-mon[30983]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:18.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:18.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:18.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:18.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:18.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:18.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:18.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:18.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:18.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:19.492 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:19 smithi052 ceph-mon[34308]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:19 smithi066 ceph-mon[34793]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:19 smithi029 ceph-mon[30983]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:20.489 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.489 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.489 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:20.490 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:20.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:20.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:20.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.757 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:20.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:20.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:20.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:21.688 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:21 smithi052 ceph-mon[34308]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:21.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:21 smithi066 ceph-mon[34793]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:21 smithi029 ceph-mon[30983]: pgmap v72: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:22.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.034+0000 7f8e24ff9640 1 -- 172.21.15.52:0/1212509401 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8e28063800 con 0x7f8e100b6480 2024-09-21T07:02:22.037 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 1 on host 'smithi052' 2024-09-21T07:02:22.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8e100b6480 msgr2=0x7f8e100b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:22.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8e100b6480 0x7f8e100b8990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800bbe0 tx=0x7f8e1800b390 comp rx=0 tx=0).stop 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 msgr2=0x7f8e2819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e2819a690 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c006010 tx=0x7f8e1c004340 comp rx=0 tx=0).stop 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 shutdown_connections 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8e100b6480 0x7f8e100b8990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e281094b0 0x7f8e2819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e28106910 0x7f8e2819a690 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 --2- 172.21.15.52:0/1212509401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e2806c6a0 0x7f8e2819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 >> 172.21.15.52:0/1212509401 conn(0x7f8e280fdff0 msgr2=0x7f8e28104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 shutdown_connections 2024-09-21T07:02:22.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:02:22.036+0000 7f8e2dd5c640 1 -- 172.21.15.52:0/1212509401 wait complete. 2024-09-21T07:02:22.616 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:22.616 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:22.616 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:22.643 DEBUG:teuthology.orchestra.run.smithi052:osd.1> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T07:02:22.645 INFO:tasks.cephadm:Deploying osd.2 on smithi066 with /dev/vg_nvme/lv_4... 2024-09-21T07:02:22.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T07:02:22.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:22.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:22.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:22.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:22.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:22.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:22.911 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:02:23.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:23 smithi066 ceph-mon[34793]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:23.771 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:23 smithi052 ceph-mon[34308]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:23.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:23 smithi029 ceph-mon[30983]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:24.493 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:24 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1[38275]: 2024-09-21T07:02:24.186+0000 7f6eefe61640 -1 osd.1 0 log_to_monitors true 2024-09-21T07:02:24.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:24 smithi066 ceph-mon[34793]: from='osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:02:24.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:24 smithi066 ceph-mon[34793]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:02:24.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:24 smithi029 ceph-mon[30983]: from='osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:02:24.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:24 smithi029 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:02:24.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:24 smithi052 ceph-mon[34308]: from='osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:02:24.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:24 smithi052 ceph-mon[34308]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T07:02:25.273 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:02:25.301 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi066:vg_nvme/lv_4 2024-09-21T07:02:25.571 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:02:25.662 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:25.663 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:02:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:02:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:02:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:02:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: pgmap v74: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T07:02:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T07:02:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:26.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 -- 172.21.15.66:0/3941739299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec801068e0 msgr2=0x7fec80108d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:26.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 --2- 172.21.15.66:0/3941739299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec801068e0 0x7fec80108d40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fec70009900 tx=0x7fec7002a410 comp rx=0 tx=0).stop 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 -- 172.21.15.66:0/3941739299 shutdown_connections 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 --2- 172.21.15.66:0/3941739299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80109480 0x7fec8010b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 --2- 172.21.15.66:0/3941739299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec801068e0 0x7fec80108d40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 --2- 172.21.15.66:0/3941739299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec8006c340 0x7fec801063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 -- 172.21.15.66:0/3941739299 >> 172.21.15.66:0/3941739299 conn(0x7fec800fdfa0 msgr2=0x7fec80100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 -- 172.21.15.66:0/3941739299 shutdown_connections 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 -- 172.21.15.66:0/3941739299 wait complete. 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.019+0000 7fec882ce640 1 Processor -- start 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec882ce640 1 -- start start 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec882ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec8006c340 0x7fec801039d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec882ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec801068e0 0x7fec801022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:26.023 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec882ce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec80109480 0x7fec801027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec882ce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fec8010f390 con 0x7fec801068e0 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec882ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec8010f210 con 0x7fec8006c340 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec882ce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec8010f510 con 0x7fec80109480 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec8006c340 0x7fec801039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8686b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec80109480 0x7fec801027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec8006c340 0x7fec801039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.66:47076/0 (socket says 172.21.15.66:47076) 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 -- 172.21.15.66:0/3294247715 learned_addr learned my addr 172.21.15.66:0/3294247715 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec85869640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec801068e0 0x7fec801022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 -- 172.21.15.66:0/3294247715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec80109480 msgr2=0x7fec801027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec80109480 0x7fec801027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 -- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec801068e0 msgr2=0x7fec801022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec801068e0 0x7fec801022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:26.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8606a640 1 -- 172.21.15.66:0/3294247715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec80102ee0 con 0x7fec8006c340 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.020+0000 7fec8686b640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec80109480 0x7fec801027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.021+0000 7fec8606a640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec8006c340 0x7fec801039d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00d950 tx=0x7fec7c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.021+0000 7fec777fe640 1 -- 172.21.15.66:0/3294247715 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c017070 con 0x7fec8006c340 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.021+0000 7fec777fe640 1 -- 172.21.15.66:0/3294247715 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec7c009c30 con 0x7fec8006c340 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.021+0000 7fec777fe640 1 -- 172.21.15.66:0/3294247715 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00f620 con 0x7fec8006c340 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.021+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec801a4040 con 0x7fec8006c340 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.021+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec801a44a0 con 0x7fec8006c340 2024-09-21T07:02:26.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.022+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec800ffac0 con 0x7fec8006c340 2024-09-21T07:02:26.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.025+0000 7fec777fe640 1 -- 172.21.15.66:0/3294247715 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fec7c010460 con 0x7fec8006c340 2024-09-21T07:02:26.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.025+0000 7fec777fe640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6500 0x7fec6c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:26.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.026+0000 7fec777fe640 1 -- 172.21.15.66:0/3294247715 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fec7c0e5490 con 0x7fec8006c340 2024-09-21T07:02:26.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.026+0000 7fec85869640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6500 0x7fec6c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:26.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.026+0000 7fec85869640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6500 0x7fec6c0b8a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec70000c00 tx=0x7fec70031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:26.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.029+0000 7fec777fe640 1 -- 172.21.15.66:0/3294247715 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec7c009de0 con 0x7fec8006c340 2024-09-21T07:02:26.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:26.234+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fec80063800 con 0x7fec6c0b6500 2024-09-21T07:02:26.493 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1[38275]: 2024-09-21T07:02:26.162+0000 7f6eec5f8640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:02:26.493 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1[38275]: 2024-09-21T07:02:26.165+0000 7f6ee3bd9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi052 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: from='osd.1 ' entity='osd.1' 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:26.792 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:26.793 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:26.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi052 2024-09-21T07:02:26.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-21T07:02:26.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:02:26.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:02:26.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:26.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:26.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: from='osd.1 ' entity='osd.1' 2024-09-21T07:02:26.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:26.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:26.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:26.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi052 2024-09-21T07:02:26.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-21T07:02:26.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:02:26.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T07:02:26.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:26.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:26.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: from='osd.1 ' entity='osd.1' 2024-09-21T07:02:26.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:26.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:26.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:27.714 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:02:27.715 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:02:27.715 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:27.715 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:27.715 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:27.715 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] boot 2024-09-21T07:02:27.715 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T07:02:27.715 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:27 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:02:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:02:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:27.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:27.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:27.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] boot 2024-09-21T07:02:27.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T07:02:27.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:27 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: pgmap v77: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: osd.1 [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] boot 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T07:02:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:27 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T07:02:29.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:29.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:02:29.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/3028912541' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"} : dispatch 2024-09-21T07:02:29.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"} : dispatch 2024-09-21T07:02:29.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"}]': finished 2024-09-21T07:02:29.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:02:29.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:29.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:29 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/3867959498' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/3028912541' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"} : dispatch 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"} : dispatch 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"}]': finished 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:29 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/3867959498' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:29.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:29.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T07:02:29.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/3028912541' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"} : dispatch 2024-09-21T07:02:29.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"} : dispatch 2024-09-21T07:02:29.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3e766f0-ba27-44b6-88b9-fb512a6b34cb"}]': finished 2024-09-21T07:02:29.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T07:02:29.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:29.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:29 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/3867959498' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:31.424 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:31 smithi029 ceph-mon[30983]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:31 smithi052 ceph-mon[34308]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:31.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:31 smithi066 ceph-mon[34793]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:33.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:33 smithi052 ceph-mon[34308]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:33.559 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:33 smithi066 ceph-mon[34793]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:33.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:33 smithi029 ceph-mon[30983]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:35.239 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:35 smithi066 ceph-mon[34793]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:35.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:35 smithi052 ceph-mon[34308]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:35.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:35 smithi029 ceph-mon[30983]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:37 smithi066 ceph-mon[34793]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:02:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:37.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:37 smithi052 ceph-mon[34308]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:37.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:02:37.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:37 smithi029 ceph-mon[30983]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T07:02:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:38.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:38 smithi052 ceph-mon[34308]: Deploying daemon osd.2 on smithi066 2024-09-21T07:02:38.579 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:38 smithi066 ceph-mon[34793]: Deploying daemon osd.2 on smithi066 2024-09-21T07:02:38.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:38 smithi029 ceph-mon[30983]: Deploying daemon osd.2 on smithi066 2024-09-21T07:02:39.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:39 smithi052 ceph-mon[34308]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:39.543 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:39 smithi066 ceph-mon[34793]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:39.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:39 smithi029 ceph-mon[30983]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:41.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:41 smithi052 ceph-mon[34308]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:41.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:41 smithi066 ceph-mon[34793]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:41.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:41 smithi029 ceph-mon[30983]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:43.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:43 smithi052 ceph-mon[34308]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:43 smithi066 ceph-mon[34793]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:43 smithi029 ceph-mon[30983]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:44.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:44.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:44.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:44.531 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:44.531 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:44.531 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:44.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:44.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:44.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:45.700 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:45 smithi066 ceph-mon[34793]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:45 smithi052 ceph-mon[34308]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:45.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:45 smithi029 ceph-mon[30983]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:47.033 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:46 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:46 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:46 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:47.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:46 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:47.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:46 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:46 smithi066 ceph-mon[34793]: pgmap v90: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:46 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:46 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:46 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:46 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:46 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:46 smithi029 ceph-mon[30983]: pgmap v90: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:46 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:46 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:46 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:46 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:46 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:46 smithi052 ceph-mon[34308]: pgmap v90: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:47.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.678+0000 7fec777fe640 1 -- 172.21.15.66:0/3294247715 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fec80063800 con 0x7fec6c0b6500 2024-09-21T07:02:47.681 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 2 on host 'smithi066' 2024-09-21T07:02:47.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6500 msgr2=0x7fec6c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6500 0x7fec6c0b8a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec70000c00 tx=0x7fec70031400 comp rx=0 tx=0).stop 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec8006c340 msgr2=0x7fec801039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec8006c340 0x7fec801039d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00d950 tx=0x7fec7c00de10 comp rx=0 tx=0).stop 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 shutdown_connections 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6500 0x7fec6c0b8a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec80109480 0x7fec801027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec801068e0 0x7fec801022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 --2- 172.21.15.66:0/3294247715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec8006c340 0x7fec801039d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 >> 172.21.15.66:0/3294247715 conn(0x7fec800fdfa0 msgr2=0x7fec80104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 shutdown_connections 2024-09-21T07:02:47.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:02:47.681+0000 7fec882ce640 1 -- 172.21.15.66:0/3294247715 wait complete. 2024-09-21T07:02:47.982 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:47 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:47.982 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:47 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.983 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:47 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:47 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:47 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:47 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:47 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:02:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:47 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:47 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:48.312 DEBUG:teuthology.orchestra.run.smithi066:osd.2> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T07:02:48.314 INFO:tasks.cephadm:Deploying osd.3 on smithi029 with /dev/vg_nvme/lv_3... 2024-09-21T07:02:48.314 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:02:48.581 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:02:48.844 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:48 smithi066 ceph-mon[34793]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:48.953 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:48 smithi029 ceph-mon[30983]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:49.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:48 smithi052 ceph-mon[34308]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:49.537 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2[39210]: 2024-09-21T07:02:49.250+0000 7f7d16c2f640 -1 osd.2 0 log_to_monitors true 2024-09-21T07:02:49.809 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:49 smithi066 ceph-mon[34793]: from='osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:02:49.809 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:49 smithi066 ceph-mon[34793]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:02:50.047 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:49 smithi029 ceph-mon[30983]: from='osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:02:50.047 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:49 smithi029 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:02:50.242 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:49 smithi052 ceph-mon[34308]: from='osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:02:50.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:49 smithi052 ceph-mon[34308]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T07:02:51.045 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2[39210]: 2024-09-21T07:02:50.783+0000 7f7d12bb1640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:02:51.046 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2[39210]: 2024-09-21T07:02:50.790+0000 7f7d0e9af640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:02:51.046 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-mon[34793]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:02:51.046 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-mon[34793]: from='osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:02:51.046 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-mon[34793]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:02:51.046 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:51.046 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-mon[34793]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:02:51.046 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-mon[34793]: pgmap v93: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:51.046 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:50 smithi066 ceph-mon[34793]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:02:51.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:50 smithi029 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:02:51.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:50 smithi029 ceph-mon[30983]: from='osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:02:51.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:50 smithi029 ceph-mon[30983]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:02:51.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:51.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:50 smithi029 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:02:51.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:50 smithi029 ceph-mon[30983]: pgmap v93: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:51.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:50 smithi029 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:02:51.167 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:50 smithi052 ceph-mon[34308]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T07:02:51.167 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:50 smithi052 ceph-mon[34308]: from='osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:02:51.167 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:50 smithi052 ceph-mon[34308]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T07:02:51.168 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:51.168 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:50 smithi052 ceph-mon[34308]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:02:51.168 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:50 smithi052 ceph-mon[34308]: pgmap v93: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:51.168 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:50 smithi052 ceph-mon[34308]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:02:51.265 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:02:51.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi029:vg_nvme/lv_3 2024-09-21T07:02:51.547 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:02:51.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:02:51.937 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi066 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:51.938 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 -- 172.21.15.29:0/2981225889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80102660 msgr2=0x7fde80102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 --2- 172.21.15.29:0/2981225889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80102660 0x7fde80102ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde7002a480 comp rx=0 tx=0).stop 2024-09-21T07:02:52.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 -- 172.21.15.29:0/2981225889 shutdown_connections 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 --2- 172.21.15.29:0/2981225889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde80104090 0x7fde8010aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 --2- 172.21.15.29:0/2981225889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde801036f0 0x7fde80103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 --2- 172.21.15.29:0/2981225889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80102660 0x7fde80102ad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 -- 172.21.15.29:0/2981225889 >> 172.21.15.29:0/2981225889 conn(0x7fde800fdfd0 msgr2=0x7fde80100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 -- 172.21.15.29:0/2981225889 shutdown_connections 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.029+0000 7fde87057640 1 -- 172.21.15.29:0/2981225889 wait complete. 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 Processor -- start 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 -- start start 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde80102660 0x7fde80106250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde801036f0 0x7fde80104b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde80104090 0x7fde80105060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010e2a0 con 0x7fde801036f0 2024-09-21T07:02:52.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010e120 con 0x7fde80104090 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde87057640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010e420 con 0x7fde80102660 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde7ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde801036f0 0x7fde80104b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde7ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde801036f0 0x7fde80104b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33036/0 (socket says 172.21.15.29:33036) 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde7ffff640 1 -- 172.21.15.29:0/3898852897 learned_addr learned my addr 172.21.15.29:0/3898852897 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.030+0000 7fde84df3640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde80102660 0x7fde80106250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde855f4640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde80104090 0x7fde80105060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7ffff640 1 -- 172.21.15.29:0/3898852897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde80102660 msgr2=0x7fde80106250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7ffff640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde80102660 0x7fde80106250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7ffff640 1 -- 172.21.15.29:0/3898852897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde80104090 msgr2=0x7fde80105060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7ffff640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde80104090 0x7fde80105060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7ffff640 1 -- 172.21.15.29:0/3898852897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde80105760 con 0x7fde801036f0 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7ffff640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde801036f0 0x7fde80104b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fde7400e9f0 tx=0x7fde7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:52.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7400cd80 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde801a40d0 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde740054d0 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74010690 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.031+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde801a4530 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.032+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde801a47f0 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.034+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fde74004e30 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.034+0000 7fde7dffb640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fde680b6480 0x7fde680b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.035+0000 7fde84df3640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fde680b6480 0x7fde680b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.035+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fde740e6280 con 0x7fde801036f0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.035+0000 7fde84df3640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fde680b6480 0x7fde680b8990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde70000c00 tx=0x7fde70031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:02:52.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.038+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde740ae140 con 0x7fde801036f0 2024-09-21T07:02:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:02:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi066 2024-09-21T07:02:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-21T07:02:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:52.237+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fde8006c290 con 0x7fde680b6480 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi066 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi066 to 17088M 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:02:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:52.901 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] boot 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: pgmap v96: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:52.902 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:02:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:02:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:02:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] boot 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: pgmap v96: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: osd.2 [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] boot 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: pgmap v96: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T07:02:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:02:53.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:02:53.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:02:53.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:02:53.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:02:53.972 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:02:53.972 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:53 smithi029 ceph-mon[30983]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:02:53.972 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:02:53.972 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:02:53.972 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:53.972 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:53.972 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48653]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:53.972 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48656]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:02:53.972 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:53.973 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:53.973 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:02:53 smithi029 sudo[48656]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:02:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:53 smithi066 ceph-mon[34793]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:02:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:02:54.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43152]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:02:54.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43152]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.102 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43152]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.102 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43155]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:02:54.102 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43155]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.102 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.102 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43155]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.167 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T07:02:54.167 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:53 smithi052 ceph-mon[34308]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T07:02:54.167 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:02:54.167 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42082]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:02:54.167 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42082]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.167 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.167 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42082]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.167 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42085]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:02:54.168 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42085]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.168 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.168 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:02:53 smithi052 sudo[42085]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.252 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48664]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:02:54.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48664]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48667]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:02:54.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48667]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.253 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 sudo[48667]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42088]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42088]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42088]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42091]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42091]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 sudo[42091]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43158]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T07:02:54.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43158]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43158]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T07:02:54.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T07:02:54.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T07:02:54.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 sudo[43161]: pam_unix(sudo:session): session closed for user root 2024-09-21T07:02:54.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:02:54.932+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fde740a9cb0 con 0x7fde801036f0 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.060 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1268089245' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9d78e06-efec-4508-bfdd-eb451ce9f219"} : dispatch 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1268089245' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9d78e06-efec-4508-bfdd-eb451ce9f219"}]': finished 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:02:55.061 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:02:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1268089245' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9d78e06-efec-4508-bfdd-eb451ce9f219"} : dispatch 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1268089245' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9d78e06-efec-4508-bfdd-eb451ce9f219"}]': finished 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:02:55.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:02:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:02:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T07:02:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: pgmap v99: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T07:02:55.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T07:02:55.245 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T07:02:55.245 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T07:02:55.245 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1268089245' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9d78e06-efec-4508-bfdd-eb451ce9f219"} : dispatch 2024-09-21T07:02:55.245 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1268089245' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9d78e06-efec-4508-bfdd-eb451ce9f219"}]': finished 2024-09-21T07:02:55.245 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T07:02:55.245 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:02:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:55 smithi052 ceph-mon[34308]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:02:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:55 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2279197932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:56.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:55 smithi066 ceph-mon[34793]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:02:56.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:55 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2279197932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:55 smithi029 ceph-mon[30983]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-21T07:02:56.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:55 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2279197932' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:02:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:56 smithi052 ceph-mon[34308]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:57.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:56 smithi066 ceph-mon[34793]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:57.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:56 smithi029 ceph-mon[30983]: pgmap v101: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:59.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:02:58 smithi052 ceph-mon[34308]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:02:58 smithi066 ceph-mon[34793]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:02:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:02:58 smithi029 ceph-mon[30983]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:01.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:00 smithi029 ceph-mon[30983]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:01.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:00 smithi052 ceph-mon[34308]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:00 smithi066 ceph-mon[34793]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:03.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:02 smithi052 ceph-mon[34308]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:02 smithi066 ceph-mon[34793]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:03.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:02 smithi029 ceph-mon[30983]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:03:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:03 smithi029 ceph-mon[30983]: Deploying daemon osd.3 on smithi029 2024-09-21T07:03:04.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:03:04.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:04.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:03 smithi052 ceph-mon[34308]: Deploying daemon osd.3 on smithi029 2024-09-21T07:03:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T07:03:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:03 smithi066 ceph-mon[34793]: Deploying daemon osd.3 on smithi029 2024-09-21T07:03:05.069 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:04 smithi029 ceph-mon[30983]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:04 smithi052 ceph-mon[34308]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:05.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:04 smithi066 ceph-mon[34793]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:07.117 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:06 smithi029 ceph-mon[30983]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:07.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:06 smithi052 ceph-mon[34308]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:07.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:06 smithi066 ceph-mon[34793]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:09.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:08 smithi052 ceph-mon[34308]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:09.325 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:08 smithi029 ceph-mon[30983]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:09.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:08 smithi066 ceph-mon[34793]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:11.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:10 smithi052 ceph-mon[34308]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:11.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:11.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:11.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:11.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:10 smithi066 ceph-mon[34793]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:11.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:11.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:11.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:11.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:10 smithi029 ceph-mon[30983]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:11.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:11.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:11.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:13.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:12 smithi052 ceph-mon[34308]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:13.297 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:12 smithi029 ceph-mon[30983]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:12 smithi066 ceph-mon[34793]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:14.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.225+0000 7fde7dffb640 1 -- 172.21.15.29:0/3898852897 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fde8006c290 con 0x7fde680b6480 2024-09-21T07:03:14.227 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 3 on host 'smithi029' 2024-09-21T07:03:14.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fde680b6480 msgr2=0x7fde680b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:14.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fde680b6480 0x7fde680b8990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde70000c00 tx=0x7fde70031400 comp rx=0 tx=0).stop 2024-09-21T07:03:14.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde801036f0 msgr2=0x7fde80104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:14.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde801036f0 0x7fde80104b20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fde7400e9f0 tx=0x7fde7400edf0 comp rx=0 tx=0).stop 2024-09-21T07:03:14.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 shutdown_connections 2024-09-21T07:03:14.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fde680b6480 0x7fde680b8990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:14.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde80104090 0x7fde80105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:14.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde801036f0 0x7fde80104b20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:14.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 --2- 172.21.15.29:0/3898852897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde80102660 0x7fde80106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:14.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 >> 172.21.15.29:0/3898852897 conn(0x7fde800fdfd0 msgr2=0x7fde8006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:14.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 shutdown_connections 2024-09-21T07:03:14.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:03:14.228+0000 7fde87057640 1 -- 172.21.15.29:0/3898852897 wait complete. 2024-09-21T07:03:14.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:14 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:14 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:14 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:14.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:14 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:14.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:14 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:14 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:14 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:14 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:14.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:14 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:14.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:14 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:14 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:14 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.605 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:14 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:14.605 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:14 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:14.605 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:14 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:14.938 DEBUG:teuthology.orchestra.run.smithi029:osd.3> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T07:03:14.940 INFO:tasks.cephadm:Deploying osd.4 on smithi052 with /dev/vg_nvme/lv_3... 2024-09-21T07:03:14.941 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:03:15.202 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:03:15.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:15 smithi052 ceph-mon[34308]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:15.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:15.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:15.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:15.465 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:15 smithi029 ceph-mon[30983]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:15.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:15.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:15.466 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:15 smithi066 ceph-mon[34793]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:16.400 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:03:16 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3[50694]: 2024-09-21T07:03:16.327+0000 7f887a8b7640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:03:17.301 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:17 smithi052 ceph-mon[34308]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:17.302 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:17 smithi052 ceph-mon[34308]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:03:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:17 smithi066 ceph-mon[34793]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:17 smithi066 ceph-mon[34793]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:03:17.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:17 smithi029 ceph-mon[30983]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:17.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:17 smithi029 ceph-mon[30983]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T07:03:18.016 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T07:03:18.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi052:vg_nvme/lv_3 2024-09-21T07:03:18.306 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:03:18.333 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:03:18.333 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:03:18.333 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:03:18.333 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:18.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.371 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3[50694]: 2024-09-21T07:03:18.206+0000 7f8876839640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:03:18.371 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3[50694]: 2024-09-21T07:03:18.211+0000 7f8872637640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:03:18.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T07:03:18.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:18.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/486395200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c341036f0 msgr2=0x7f8c34103b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/486395200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c341036f0 0x7f8c34103b00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009900 tx=0x7f8c2802a480 comp rx=0 tx=0).stop 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/486395200 shutdown_connections 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/486395200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c34104090 0x7f8c3410aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/486395200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c341036f0 0x7f8c34103b00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/486395200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c34102660 0x7f8c34102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/486395200 >> 172.21.15.52:0/486395200 conn(0x7f8c340fdfd0 msgr2=0x7f8c34100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/486395200 shutdown_connections 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.792+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/486395200 wait complete. 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 Processor -- start 2024-09-21T07:03:18.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 -- start start 2024-09-21T07:03:18.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c34102660 0x7f8c3410cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:18.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c341036f0 0x7f8c3410b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:18.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c34104090 0x7f8c3410bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:18.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3410f3d0 con 0x7f8c341036f0 2024-09-21T07:03:18.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3410f250 con 0x7f8c34104090 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.793+0000 7f8c3a9e2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3410f550 con 0x7f8c34102660 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c34104090 0x7f8c3410bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c34104090 0x7f8c3410bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50340/0 (socket says 172.21.15.52:50340) 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 -- 172.21.15.52:0/1022283378 learned_addr learned my addr 172.21.15.52:0/1022283378 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c337fe640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c341036f0 0x7f8c3410b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c33fff640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c34102660 0x7f8c3410cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 -- 172.21.15.52:0/1022283378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c34102660 msgr2=0x7f8c3410cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c34102660 0x7f8c3410cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 -- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c341036f0 msgr2=0x7f8c3410b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c341036f0 0x7f8c3410b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 -- 172.21.15.52:0/1022283378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3410c2b0 con 0x7f8c34104090 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c33fff640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c34102660 0x7f8c3410cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:03:18.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c38f7f640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c34104090 0x7f8c3410bbb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00cad0 tx=0x7f8c2c00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c317fa640 1 -- 172.21.15.52:0/1022283378 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c00ae20 con 0x7f8c34104090 2024-09-21T07:03:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c317fa640 1 -- 172.21.15.52:0/1022283378 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c2c005020 con 0x7f8c34104090 2024-09-21T07:03:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.794+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c341a40c0 con 0x7f8c34104090 2024-09-21T07:03:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.795+0000 7f8c317fa640 1 -- 172.21.15.52:0/1022283378 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c00f6b0 con 0x7f8c34104090 2024-09-21T07:03:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.795+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c341a4520 con 0x7f8c34104090 2024-09-21T07:03:18.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.796+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c34109840 con 0x7f8c34104090 2024-09-21T07:03:18.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.797+0000 7f8c317fa640 1 -- 172.21.15.52:0/1022283378 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8c2c0051d0 con 0x7f8c34104090 2024-09-21T07:03:18.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.798+0000 7f8c317fa640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8c1c0b6590 0x7f8c1c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:18.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.798+0000 7f8c317fa640 1 -- 172.21.15.52:0/1022283378 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f8c2c0e6440 con 0x7f8c34104090 2024-09-21T07:03:18.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.798+0000 7f8c33fff640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8c1c0b6590 0x7f8c1c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:18.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.799+0000 7f8c33fff640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8c1c0b6590 0x7f8c1c0b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c240058c0 tx=0x7f8c24005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:18.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.802+0000 7f8c317fa640 1 -- 172.21.15.52:0/1022283378 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c2c014030 con 0x7f8c34104090 2024-09-21T07:03:19.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:18.998+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8c34063800 con 0x7f8c1c0b6590 2024-09-21T07:03:19.367 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi029 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi029 to 8546M 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:19.368 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:19 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi029 2024-09-21T07:03:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi029 to 8546M 2024-09-21T07:03:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:03:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:03:19.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:19.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:19.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:19.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:19.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:19 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi029 2024-09-21T07:03:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi029 to 8546M 2024-09-21T07:03:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: from='osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:03:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T07:03:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:19.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:19 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:20.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:20 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:03:20.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:20 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:03:20.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:20 smithi052 ceph-mon[34308]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:20.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:20 smithi052 ceph-mon[34308]: osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] boot 2024-09-21T07:03:20.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:20 smithi052 ceph-mon[34308]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T07:03:20.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:20.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:20 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:03:20.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:20 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:03:20.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:20 smithi066 ceph-mon[34793]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:20.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:20 smithi066 ceph-mon[34793]: osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] boot 2024-09-21T07:03:20.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:20 smithi066 ceph-mon[34793]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T07:03:20.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:20.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:20 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:03:20.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:20 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:03:20.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:20 smithi029 ceph-mon[30983]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:20.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:20 smithi029 ceph-mon[30983]: osd.3 [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] boot 2024-09-21T07:03:20.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:20 smithi029 ceph-mon[30983]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T07:03:20.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T07:03:21.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:21 smithi052 ceph-mon[34308]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:21.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:21 smithi052 ceph-mon[34308]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:03:21.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:21 smithi052 ceph-mon[34308]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:03:21.516 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:21 smithi066 ceph-mon[34793]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:21.516 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:21 smithi066 ceph-mon[34793]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:03:21.516 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:21 smithi066 ceph-mon[34793]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:03:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:21 smithi029 ceph-mon[30983]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-21T07:03:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:21 smithi029 ceph-mon[30983]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T07:03:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:21 smithi029 ceph-mon[30983]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T07:03:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:22 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/902027391' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"} : dispatch 2024-09-21T07:03:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:22 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"} : dispatch 2024-09-21T07:03:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:22 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"}]': finished 2024-09-21T07:03:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:22 smithi052 ceph-mon[34308]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:03:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:22 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/1130515243' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:22 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/902027391' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"} : dispatch 2024-09-21T07:03:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:22 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"} : dispatch 2024-09-21T07:03:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:22 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"}]': finished 2024-09-21T07:03:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:22 smithi066 ceph-mon[34793]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:03:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:22.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:22 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/1130515243' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:22 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/902027391' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"} : dispatch 2024-09-21T07:03:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:22 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"} : dispatch 2024-09-21T07:03:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:22 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dde7a9d8-18ea-4717-85b7-d747f1bd620c"}]': finished 2024-09-21T07:03:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:22 smithi029 ceph-mon[30983]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T07:03:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:22.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:22 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/1130515243' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:23 smithi029 ceph-mon[30983]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:23 smithi052 ceph-mon[34308]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:23 smithi066 ceph-mon[34793]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:25 smithi029 ceph-mon[30983]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T07:03:25.738 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:25 smithi052 ceph-mon[34308]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T07:03:25.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:25 smithi066 ceph-mon[34793]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T07:03:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:27 smithi052 ceph-mon[34308]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:03:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:27 smithi066 ceph-mon[34793]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:03:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:27 smithi029 ceph-mon[30983]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:03:29.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:29 smithi052 ceph-mon[34308]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T07:03:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:29 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:03:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:29 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:29 smithi066 ceph-mon[34793]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T07:03:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:29 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:03:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:29 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:29 smithi029 ceph-mon[30983]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T07:03:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T07:03:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:30.675 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:30 smithi052 ceph-mon[34308]: Deploying daemon osd.4 on smithi052 2024-09-21T07:03:30.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:30 smithi066 ceph-mon[34793]: Deploying daemon osd.4 on smithi052 2024-09-21T07:03:30.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:30 smithi029 ceph-mon[30983]: Deploying daemon osd.4 on smithi052 2024-09-21T07:03:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:31 smithi052 ceph-mon[34308]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:03:31.772 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:31 smithi029 ceph-mon[30983]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:03:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:31 smithi066 ceph-mon[34793]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T07:03:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:33 smithi052 ceph-mon[34308]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T07:03:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:33 smithi066 ceph-mon[34793]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T07:03:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:33 smithi029 ceph-mon[30983]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T07:03:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:35 smithi052 ceph-mon[34308]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:03:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:35 smithi066 ceph-mon[34793]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:03:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:35 smithi029 ceph-mon[30983]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:03:36.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:36.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:36.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:36.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:36.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:36.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:36.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:36.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:36.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:37.914 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:37 smithi052 ceph-mon[34308]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:38.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:37 smithi066 ceph-mon[34793]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:37 smithi029 ceph-mon[30983]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:39.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:38 smithi052 ceph-mon[34308]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:39.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:39.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:39.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:38 smithi066 ceph-mon[34793]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:39.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:38 smithi029 ceph-mon[30983]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:39.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:39.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:39.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:39.619 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 4 on host 'smithi052' 2024-09-21T07:03:39.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.616+0000 7f8c317fa640 1 -- 172.21.15.52:0/1022283378 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8c34063800 con 0x7f8c1c0b6590 2024-09-21T07:03:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8c1c0b6590 msgr2=0x7f8c1c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8c1c0b6590 0x7f8c1c0b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c240058c0 tx=0x7f8c24005850 comp rx=0 tx=0).stop 2024-09-21T07:03:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c34104090 msgr2=0x7f8c3410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c34104090 0x7f8c3410bbb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00cad0 tx=0x7f8c2c00cf90 comp rx=0 tx=0).stop 2024-09-21T07:03:39.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 shutdown_connections 2024-09-21T07:03:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8c1c0b6590 0x7f8c1c0b8aa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c34104090 0x7f8c3410bbb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c341036f0 0x7f8c3410b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 --2- 172.21.15.52:0/1022283378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c34102660 0x7f8c3410cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 >> 172.21.15.52:0/1022283378 conn(0x7f8c340fdfd0 msgr2=0x7f8c34106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 shutdown_connections 2024-09-21T07:03:39.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:03:39.619+0000 7f8c3a9e2640 1 -- 172.21.15.52:0/1022283378 wait complete. 2024-09-21T07:03:40.200 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:39 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:40.201 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:39 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:40.201 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:39 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:40.227 DEBUG:teuthology.orchestra.run.smithi052:osd.4> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T07:03:40.229 INFO:tasks.cephadm:Deploying osd.5 on smithi066 with /dev/vg_nvme/lv_3... 2024-09-21T07:03:40.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T07:03:40.258 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:40.258 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:40.258 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:39 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:40.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:03:40.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:40.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:39 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:40.493 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:41.678 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:41 smithi052 ceph-mon[34308]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:41 smithi066 ceph-mon[34793]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:41 smithi029 ceph-mon[30983]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:41.989 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:03:41 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4[44686]: 2024-09-21T07:03:41.737+0000 7f786c6b3640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:03:42.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:42 smithi052 ceph-mon[34308]: from='osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:03:42.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:42 smithi052 ceph-mon[34308]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:03:42.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:42 smithi029 ceph-mon[30983]: from='osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:03:42.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:42 smithi029 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:03:42.883 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:42 smithi066 ceph-mon[34793]: from='osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:03:42.883 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:42 smithi066 ceph-mon[34793]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T07:03:42.993 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:03:43.019 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi066:vg_nvme/lv_3 2024-09-21T07:03:43.319 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:43.693 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:43.694 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.694 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:43.694 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:43.694 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 -- 172.21.15.66:0/642342447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f01036e0 msgr2=0x7f90f0103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:43.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/642342447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f01036e0 0x7f90f0103af0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009900 tx=0x7f90dc02a480 comp rx=0 tx=0).stop 2024-09-21T07:03:43.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 -- 172.21.15.66:0/642342447 shutdown_connections 2024-09-21T07:03:43.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/642342447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90f0104080 0x7f90f010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/642342447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f01036e0 0x7f90f0103af0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/642342447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 0x7f90f0102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 -- 172.21.15.66:0/642342447 >> 172.21.15.66:0/642342447 conn(0x7f90f00fdfa0 msgr2=0x7f90f0100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:03:43.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 -- 172.21.15.66:0/642342447 shutdown_connections 2024-09-21T07:03:43.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.815+0000 7f90f6ff5640 1 -- 172.21.15.66:0/642342447 wait complete. 2024-09-21T07:03:43.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 Processor -- start 2024-09-21T07:03:43.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 -- start start 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 0x7f90f0199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90f01036e0 0x7f90f019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f0104080 0x7f90f019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f90f010e2a0 con 0x7f90f01036e0 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90f010e120 con 0x7f90f0102650 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f6ff5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f90f010e420 con 0x7f90f0104080 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f4d91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 0x7f90f0199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f5592640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f0104080 0x7f90f019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f4d91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 0x7f90f0199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.66:51076/0 (socket says 172.21.15.66:51076) 2024-09-21T07:03:43.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f4d91640 1 -- 172.21.15.66:0/4014453822 learned_addr learned my addr 172.21.15.66:0/4014453822 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90effff640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90f01036e0 0x7f90f019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f4d91640 1 -- 172.21.15.66:0/4014453822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f0104080 msgr2=0x7f90f019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.816+0000 7f90f4d91640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f0104080 0x7f90f019b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90f4d91640 1 -- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90f01036e0 msgr2=0x7f90f019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90f4d91640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90f01036e0 0x7f90f019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90f4d91640 1 -- 172.21.15.66:0/4014453822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f019b9f0 con 0x7f90f0102650 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90f5592640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f0104080 0x7f90f019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90f4d91640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 0x7f90f0199fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e9f0 tx=0x7f90e400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90edffb640 1 -- 172.21.15.66:0/4014453822 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e400cd80 con 0x7f90f0102650 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90edffb640 1 -- 172.21.15.66:0/4014453822 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90e40054d0 con 0x7f90f0102650 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90edffb640 1 -- 172.21.15.66:0/4014453822 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4010690 con 0x7f90f0102650 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f019bce0 con 0x7f90f0102650 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.817+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f01a23e0 con 0x7f90f0102650 2024-09-21T07:03:43.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.818+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f01a25b0 con 0x7f90f0102650 2024-09-21T07:03:43.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.820+0000 7f90edffb640 1 -- 172.21.15.66:0/4014453822 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f90e4004e30 con 0x7f90f0102650 2024-09-21T07:03:43.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.821+0000 7f90edffb640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90e00b6510 0x7f90e00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:03:43.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.821+0000 7f90edffb640 1 -- 172.21.15.66:0/4014453822 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f90e40e6800 con 0x7f90f0102650 2024-09-21T07:03:43.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.821+0000 7f90effff640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90e00b6510 0x7f90e00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:03:43.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.822+0000 7f90effff640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90e00b6510 0x7f90e00b8a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f90dc000c00 tx=0x7f90dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:03:43.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:43.825+0000 7f90edffb640 1 -- 172.21.15.66:0/4014453822 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90e40ae180 con 0x7f90f0102650 2024-09-21T07:03:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:03:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:03:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:03:44.025 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:03:44.024+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f90f006c1a0 con 0x7f90e00b6510 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi052 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:44.688 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:44 smithi066 ceph-mon[34793]: from='osd.4 ' entity='osd.4' 2024-09-21T07:03:44.743 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4[44686]: 2024-09-21T07:03:44.384+0000 7f7868635640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:03:44.743 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4[44686]: 2024-09-21T07:03:44.390+0000 7f786042b640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:03:44.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi052 2024-09-21T07:03:44.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:44.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:44 smithi052 ceph-mon[34308]: from='osd.4 ' entity='osd.4' 2024-09-21T07:03:45.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi052 2024-09-21T07:03:45.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-21T07:03:45.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:03:45.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T07:03:45.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:45.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:45.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:03:45.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:03:45.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:45.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:44 smithi029 ceph-mon[30983]: from='osd.4 ' entity='osd.4' 2024-09-21T07:03:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:03:45.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:03:45.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:45.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:45.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:45.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] boot 2024-09-21T07:03:45.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T07:03:45.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:45 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:03:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:03:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] boot 2024-09-21T07:03:45.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T07:03:45.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:45 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:03:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:03:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-21T07:03:46.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:03:46.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:46.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: osd.4 [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] boot 2024-09-21T07:03:46.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T07:03:46.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:45 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T07:03:46.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:46 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/2202846768' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"} : dispatch 2024-09-21T07:03:46.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:46 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"} : dispatch 2024-09-21T07:03:46.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:46 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"}]': finished 2024-09-21T07:03:46.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:46 smithi066 ceph-mon[34793]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T07:03:46.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:46 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:03:46.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:46 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/2202846768' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"} : dispatch 2024-09-21T07:03:46.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:46 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"} : dispatch 2024-09-21T07:03:46.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:46 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"}]': finished 2024-09-21T07:03:46.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:46 smithi052 ceph-mon[34308]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T07:03:46.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:46 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:03:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:46 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/2202846768' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"} : dispatch 2024-09-21T07:03:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:46 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"} : dispatch 2024-09-21T07:03:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:46 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d329891b-ec44-4ca8-bc4b-a770ba76ea24"}]': finished 2024-09-21T07:03:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:46 smithi029 ceph-mon[30983]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T07:03:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:46 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:03:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:47 smithi052 ceph-mon[34308]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:47 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/4275264174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:47 smithi066 ceph-mon[34793]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:47 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/4275264174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:47 smithi029 ceph-mon[30983]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:47 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/4275264174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:03:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:49 smithi052 ceph-mon[34308]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:49 smithi066 ceph-mon[34793]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:50.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:49 smithi029 ceph-mon[30983]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:51 smithi066 ceph-mon[34793]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:51 smithi052 ceph-mon[34308]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:51 smithi029 ceph-mon[30983]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:53.829 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:53 smithi066 ceph-mon[34793]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:53 smithi052 ceph-mon[34308]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:53 smithi029 ceph-mon[30983]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:55.817 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:55 smithi066 ceph-mon[34793]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:55.818 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:03:55.818 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:55 smithi052 ceph-mon[34308]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:03:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:55 smithi029 ceph-mon[30983]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T07:03:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:03:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:56 smithi052 ceph-mon[34308]: Deploying daemon osd.5 on smithi066 2024-09-21T07:03:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:56 smithi066 ceph-mon[34793]: Deploying daemon osd.5 on smithi066 2024-09-21T07:03:57.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:56 smithi029 ceph-mon[30983]: Deploying daemon osd.5 on smithi066 2024-09-21T07:03:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:57 smithi066 ceph-mon[34793]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:57 smithi052 ceph-mon[34308]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:57 smithi029 ceph-mon[30983]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:59.754 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:03:59 smithi066 ceph-mon[34793]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:03:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:03:59 smithi052 ceph-mon[34308]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:00.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:03:59 smithi029 ceph-mon[30983]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:01.923 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:01 smithi029 ceph-mon[30983]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:01.924 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:01.924 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:01.924 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:01 smithi052 ceph-mon[34308]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:01 smithi066 ceph-mon[34793]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:03 smithi052 ceph-mon[34308]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:03 smithi066 ceph-mon[34793]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:03 smithi029 ceph-mon[30983]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:04.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.567+0000 7f90edffb640 1 -- 172.21.15.66:0/4014453822 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f90f006c1a0 con 0x7f90e00b6510 2024-09-21T07:04:04.569 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 5 on host 'smithi066' 2024-09-21T07:04:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90e00b6510 msgr2=0x7f90e00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90e00b6510 0x7f90e00b8a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f90dc000c00 tx=0x7f90dc031400 comp rx=0 tx=0).stop 2024-09-21T07:04:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 msgr2=0x7f90f0199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:04.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 0x7f90f0199fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f90e400e9f0 tx=0x7f90e400edf0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 shutdown_connections 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90e00b6510 0x7f90e00b8a20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90f0104080 0x7f90f019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90f01036e0 0x7f90f019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 --2- 172.21.15.66:0/4014453822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90f0102650 0x7f90f0199fc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 >> 172.21.15.66:0/4014453822 conn(0x7f90f00fdfa0 msgr2=0x7f90f006ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 shutdown_connections 2024-09-21T07:04:04.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:04:04.570+0000 7f90f6ff5640 1 -- 172.21.15.66:0/4014453822 wait complete. 2024-09-21T07:04:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:04.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:04.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:05.141 DEBUG:teuthology.orchestra.run.smithi066:osd.5> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T07:04:05.143 INFO:tasks.cephadm:Deploying osd.6 on smithi029 with /dev/vg_nvme/lv_2... 2024-09-21T07:04:05.143 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:04:05.410 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:05.782 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:05 smithi029 ceph-mon[30983]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:05.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:05 smithi066 ceph-mon[34793]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:05.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:05 smithi052 ceph-mon[34308]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:07.347 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:04:07 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:04:07.014+0000 7f4532397640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:04:07.975 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:07 smithi066 ceph-mon[34793]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:07.975 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:07 smithi066 ceph-mon[34793]: from='osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:04:07.975 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:07 smithi066 ceph-mon[34793]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:04:07.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:07 smithi052 ceph-mon[34308]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:07.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:07 smithi052 ceph-mon[34308]: from='osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:04:07.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:07 smithi052 ceph-mon[34308]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:04:08.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:07 smithi029 ceph-mon[30983]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:08.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:07 smithi029 ceph-mon[30983]: from='osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:04:08.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:07 smithi029 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T07:04:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:04:08.412 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi029:vg_nvme/lv_2 2024-09-21T07:04:08.671 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:08.949 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:08.950 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:08 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:08.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:08.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:08.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:08.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:08.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:08 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:09.101 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:04:08.700+0000 7f452e319640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:04:09.101 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:04:08.712+0000 7f452a117640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:04:09.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:09.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:08 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:09.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 -- 172.21.15.29:0/1174175354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 msgr2=0x7f2a6010a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 --2- 172.21.15.29:0/1174175354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a6010a8c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009ca0 tx=0x7f2a5802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 -- 172.21.15.29:0/1174175354 shutdown_connections 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 --2- 172.21.15.29:0/1174175354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a6010a8c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 --2- 172.21.15.29:0/1174175354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a60105790 0x7f2a60107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 --2- 172.21.15.29:0/1174175354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a60102cd0 0x7f2a60105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 -- 172.21.15.29:0/1174175354 >> 172.21.15.29:0/1174175354 conn(0x7f2a600fd770 msgr2=0x7f2a600ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 -- 172.21.15.29:0/1174175354 shutdown_connections 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.154+0000 7f2a67027640 1 -- 172.21.15.29:0/1174175354 wait complete. 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 Processor -- start 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 -- start start 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a60102cd0 0x7f2a60102190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:09.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a60105790 0x7f2a601a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a601a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6010e2e0 con 0x7f2a601083b0 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6010e160 con 0x7f2a60102cd0 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a67027640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6010e460 con 0x7f2a60105790 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a601a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a601a3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47976/0 (socket says 172.21.15.29:47976) 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 -- 172.21.15.29:0/823345115 learned_addr learned my addr 172.21.15.29:0/823345115 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a64dc3640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a60102cd0 0x7f2a60102190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a5ffff640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a60105790 0x7f2a601a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 -- 172.21.15.29:0/823345115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a60105790 msgr2=0x7f2a601a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a60105790 0x7f2a601a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 -- 172.21.15.29:0/823345115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a60102cd0 msgr2=0x7f2a60102190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a60102cd0 0x7f2a60102190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.155+0000 7f2a655c4640 1 -- 172.21.15.29:0/823345115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a601a3c80 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.156+0000 7f2a655c4640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a601a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a58004af0 tx=0x7f2a58003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.156+0000 7f2a5dffb640 1 -- 172.21.15.29:0/823345115 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58004240 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.156+0000 7f2a5dffb640 1 -- 172.21.15.29:0/823345115 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a5802f380 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.156+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a601a3f10 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.156+0000 7f2a5dffb640 1 -- 172.21.15.29:0/823345115 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5802fc60 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.156+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a601a4370 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.157+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a600ff290 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.159+0000 7f2a5dffb640 1 -- 172.21.15.29:0/823345115 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2a580043e0 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.159+0000 7f2a5dffb640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2a480b6510 0x7f2a480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.159+0000 7f2a64dc3640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2a480b6510 0x7f2a480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.159+0000 7f2a5dffb640 1 -- 172.21.15.29:0/823345115 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4253+0+0 (secure 0 0 0) 0x7f2a58107950 con 0x7f2a601083b0 2024-09-21T07:04:09.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.160+0000 7f2a64dc3640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2a480b6510 0x7f2a480b8a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a50005fd0 tx=0x7f2a5000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:09.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.163+0000 7f2a5dffb640 1 -- 172.21.15.29:0/823345115 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a580cf1c0 con 0x7f2a601083b0 2024-09-21T07:04:09.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:09.361+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2a60063800 con 0x7f2a480b6510 2024-09-21T07:04:09.983 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi066 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:09.984 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi066 2024-09-21T07:04:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-21T07:04:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:04:09.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:04:09.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:09.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:09.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:09.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:09.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:10.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:10.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi066 2024-09-21T07:04:10.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi066 to 8544M 2024-09-21T07:04:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:04:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T07:04:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:10.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:10 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:04:10.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:10 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:04:10.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:10 smithi052 ceph-mon[34308]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:10.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:10 smithi052 ceph-mon[34308]: osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] boot 2024-09-21T07:04:10.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:10 smithi052 ceph-mon[34308]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T07:04:10.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:11.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:10 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:04:11.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:10 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:04:11.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:10 smithi029 ceph-mon[30983]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:11.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:10 smithi029 ceph-mon[30983]: osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] boot 2024-09-21T07:04:11.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:10 smithi029 ceph-mon[30983]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T07:04:11.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:11.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:10 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:04:11.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:10 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:04:11.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:10 smithi066 ceph-mon[34793]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:11.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:10 smithi066 ceph-mon[34793]: osd.5 [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] boot 2024-09-21T07:04:11.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:10 smithi066 ceph-mon[34793]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T07:04:11.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T07:04:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:11 smithi029 ceph-mon[30983]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:11 smithi029 ceph-mon[30983]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T07:04:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:11 smithi052 ceph-mon[34308]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:11 smithi052 ceph-mon[34308]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T07:04:12.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:11 smithi066 ceph-mon[34793]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-21T07:04:12.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:11 smithi066 ceph-mon[34793]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T07:04:12.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:12 smithi029 ceph-mon[30983]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:04:12.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:12 smithi029 ceph-mon[30983]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:12.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:12 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4228666853' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "69cab741-228d-4d88-80e0-a871ae498271"} : dispatch 2024-09-21T07:04:12.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:12 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4228666853' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69cab741-228d-4d88-80e0-a871ae498271"}]': finished 2024-09-21T07:04:12.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:12 smithi029 ceph-mon[30983]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T07:04:12.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:12.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:12 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3323607832' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:04:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:12 smithi052 ceph-mon[34308]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:04:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:12 smithi052 ceph-mon[34308]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:12 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4228666853' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "69cab741-228d-4d88-80e0-a871ae498271"} : dispatch 2024-09-21T07:04:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:12 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4228666853' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69cab741-228d-4d88-80e0-a871ae498271"}]': finished 2024-09-21T07:04:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:12 smithi052 ceph-mon[34308]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T07:04:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:12 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3323607832' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:04:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:12 smithi066 ceph-mon[34793]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T07:04:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:12 smithi066 ceph-mon[34793]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:12 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4228666853' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "69cab741-228d-4d88-80e0-a871ae498271"} : dispatch 2024-09-21T07:04:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:12 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4228666853' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69cab741-228d-4d88-80e0-a871ae498271"}]': finished 2024-09-21T07:04:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:12 smithi066 ceph-mon[34793]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T07:04:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:12 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3323607832' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:04:15.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:14 smithi052 ceph-mon[34308]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-09-21T07:04:15.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:14 smithi066 ceph-mon[34793]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-09-21T07:04:15.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:14 smithi029 ceph-mon[30983]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-09-21T07:04:17.311 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:16 smithi029 ceph-mon[30983]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:04:17.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:16 smithi066 ceph-mon[34793]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:04:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:16 smithi052 ceph-mon[34308]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:04:19.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:18 smithi066 ceph-mon[34793]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T07:04:19.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:18 smithi029 ceph-mon[30983]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T07:04:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:18 smithi052 ceph-mon[34308]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T07:04:21.259 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:20 smithi052 ceph-mon[34308]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:04:21.259 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:04:21.259 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:21.259 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:20 smithi052 ceph-mon[34308]: Deploying daemon osd.6 on smithi029 2024-09-21T07:04:21.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:20 smithi029 ceph-mon[30983]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:04:21.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:04:21.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:21.337 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:20 smithi029 ceph-mon[30983]: Deploying daemon osd.6 on smithi029 2024-09-21T07:04:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:20 smithi066 ceph-mon[34793]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T07:04:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T07:04:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:20 smithi066 ceph-mon[34793]: Deploying daemon osd.6 on smithi029 2024-09-21T07:04:23.318 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:23 smithi029 ceph-mon[30983]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:04:23.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:23 smithi066 ceph-mon[34793]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:04:23.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:23 smithi052 ceph-mon[34308]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:04:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:25 smithi066 ceph-mon[34793]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:04:25.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:25 smithi029 ceph-mon[30983]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:04:25.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:25 smithi052 ceph-mon[34308]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:04:27.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:27 smithi066 ceph-mon[34793]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:27.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:27 smithi029 ceph-mon[30983]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:27.492 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:27 smithi052 ceph-mon[34308]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:28.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:28.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:28.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:28.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:28.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:28.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:28.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:28.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:28.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:29.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:29 smithi029 ceph-mon[30983]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:29 smithi052 ceph-mon[34308]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:29.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:29 smithi066 ceph-mon[34793]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:31.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.233+0000 7f2a5dffb640 1 -- 172.21.15.29:0/823345115 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2a60063800 con 0x7f2a480b6510 2024-09-21T07:04:31.238 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 6 on host 'smithi029' 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2a480b6510 msgr2=0x7f2a480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2a480b6510 0x7f2a480b8a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a50005fd0 tx=0x7f2a5000b390 comp rx=0 tx=0).stop 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 msgr2=0x7f2a601a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a601a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2a58004af0 tx=0x7f2a58003c20 comp rx=0 tx=0).stop 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 shutdown_connections 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2a480b6510 0x7f2a480b8a20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a601083b0 0x7f2a601a3670 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a60105790 0x7f2a601a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 --2- 172.21.15.29:0/823345115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a60102cd0 0x7f2a60102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 >> 172.21.15.29:0/823345115 conn(0x7f2a600fd770 msgr2=0x7f2a60103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:31.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 shutdown_connections 2024-09-21T07:04:31.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:04:31.236+0000 7f2a67027640 1 -- 172.21.15.29:0/823345115 wait complete. 2024-09-21T07:04:31.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:31 smithi066 ceph-mon[34793]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:31.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:31.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:31.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:31 smithi029 ceph-mon[30983]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:31.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:31.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:31.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:31 smithi052 ceph-mon[34308]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:31.919 DEBUG:teuthology.orchestra.run.smithi029:osd.6> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T07:04:31.921 INFO:tasks.cephadm:Deploying osd.7 on smithi052 with /dev/vg_nvme/lv_2... 2024-09-21T07:04:31.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:04:32.181 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:04:32.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:32 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:32.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:32 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:32.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:32 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:32.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:32 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:32.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:32 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:32.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:32 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:32.362 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:32 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:32.362 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:32 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:32.362 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:32 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:33.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:33 smithi029 ceph-mon[30983]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:33.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:33 smithi029 ceph-mon[30983]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:04:33.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:04:33 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:04:33.178+0000 7f78f04c1640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:04:33.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:33 smithi052 ceph-mon[34308]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:33.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:33 smithi052 ceph-mon[34308]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:04:33.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:33 smithi066 ceph-mon[34793]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:33.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:33 smithi066 ceph-mon[34793]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T07:04:34.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:34 smithi029 ceph-mon[30983]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:04:34.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:34 smithi029 ceph-mon[30983]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:04:34.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:34 smithi029 ceph-mon[30983]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:04:34.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:34 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:34.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:34 smithi029 ceph-mon[30983]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:04:34.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:34 smithi052 ceph-mon[34308]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:04:34.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:34 smithi052 ceph-mon[34308]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:04:34.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:34 smithi052 ceph-mon[34308]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:04:34.463 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:34 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:34.464 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:34 smithi052 ceph-mon[34308]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:04:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:34 smithi066 ceph-mon[34793]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T07:04:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:34 smithi066 ceph-mon[34793]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T07:04:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:34 smithi066 ceph-mon[34793]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:04:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:34.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:34 smithi066 ceph-mon[34793]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:04:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T07:04:34.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi052:vg_nvme/lv_2 2024-09-21T07:04:35.062 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:04:35.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:04:35 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:04:35.100+0000 7f78ec443640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:04:35.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:04:35 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:04:35.109+0000 7f78e4239640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:04:35.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:35 smithi029 ceph-mon[30983]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:35.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:35 smithi029 ceph-mon[30983]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:04:35.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:35 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:35.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:35 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:35.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:35 smithi029 ceph-mon[30983]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' 2024-09-21T07:04:35.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:35 smithi052 ceph-mon[34308]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:35.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:35 smithi052 ceph-mon[34308]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:04:35.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:35 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:35.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:35 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:35.457 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:35 smithi052 ceph-mon[34308]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' 2024-09-21T07:04:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 -- 172.21.15.52:0/727193954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8102640 msgr2=0x7fe7d8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 --2- 172.21.15.52:0/727193954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8102640 0x7fe7d8102ab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009900 tx=0x7fe7c002a480 comp rx=0 tx=0).stop 2024-09-21T07:04:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 -- 172.21.15.52:0/727193954 shutdown_connections 2024-09-21T07:04:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 --2- 172.21.15.52:0/727193954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7d8104070 0x7fe7d810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 --2- 172.21.15.52:0/727193954 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7d81036d0 0x7fe7d8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 --2- 172.21.15.52:0/727193954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8102640 0x7fe7d8102ab0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 -- 172.21.15.52:0/727193954 >> 172.21.15.52:0/727193954 conn(0x7fe7d80fdfb0 msgr2=0x7fe7d8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 -- 172.21.15.52:0/727193954 shutdown_connections 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.550+0000 7fe7df159640 1 -- 172.21.15.52:0/727193954 wait complete. 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 Processor -- start 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 -- start start 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7d8102640 0x7fe7d8199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d81036d0 0x7fe7d819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7d8104070 0x7fe7d819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d810e280 con 0x7fe7d8102640 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d810e100 con 0x7fe7d81036d0 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7df159640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d810e400 con 0x7fe7d8104070 2024-09-21T07:04:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7d7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d81036d0 0x7fe7d819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7d7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d81036d0 0x7fe7d819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53280/0 (socket says 172.21.15.52:53280) 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7d7fff640 1 -- 172.21.15.52:0/1762654690 learned_addr learned my addr 172.21.15.52:0/1762654690 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.551+0000 7fe7dcef5640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7d8102640 0x7fe7d8199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7dd6f6640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7d8104070 0x7fe7d819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d7fff640 1 -- 172.21.15.52:0/1762654690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7d8104070 msgr2=0x7fe7d819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d7fff640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7d8104070 0x7fe7d819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d7fff640 1 -- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7d8102640 msgr2=0x7fe7d8199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d7fff640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7d8102640 0x7fe7d8199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d7fff640 1 -- 172.21.15.52:0/1762654690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d819b9d0 con 0x7fe7d81036d0 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7dd6f6640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7d8104070 0x7fe7d819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d7fff640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d81036d0 0x7fe7d819a610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800eab0 tx=0x7fe7c800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d5ffb640 1 -- 172.21.15.52:0/1762654690 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800ce40 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d5ffb640 1 -- 172.21.15.52:0/1762654690 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c8011920 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d819bcc0 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7d5ffb640 1 -- 172.21.15.52:0/1762654690 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8010a30 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.552+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d81a23c0 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.553+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d81a2590 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.555+0000 7fe7d5ffb640 1 -- 172.21.15.52:0/1762654690 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe7c8010bd0 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.555+0000 7fe7d5ffb640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe7c40b6510 0x7fe7c40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.555+0000 7fe7dcef5640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe7c40b6510 0x7fe7c40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.555+0000 7fe7d5ffb640 1 -- 172.21.15.52:0/1762654690 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4685+0+0 (secure 0 0 0) 0x7fe7c80e6b30 con 0x7fe7d81036d0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.556+0000 7fe7dcef5640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe7c40b6510 0x7fe7c40b8a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0000c00 tx=0x7fe7c0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:04:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.560+0000 7fe7d5ffb640 1 -- 172.21.15.52:0/1762654690 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7c8016030 con 0x7fe7d81036d0 2024-09-21T07:04:35.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:35 smithi066 ceph-mon[34793]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:35.726 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:35 smithi066 ceph-mon[34793]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T07:04:35.726 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:35 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:35.726 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:35 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:35.726 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:35 smithi066 ceph-mon[34793]: from='osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725]' entity='osd.6' 2024-09-21T07:04:35.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:35.762+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe7d806b570 con 0x7fe7c40b6510 2024-09-21T07:04:36.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi029 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi029 to 5697M 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:36.477 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:36.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:36.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:36.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:36.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] boot 2024-09-21T07:04:36.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T07:04:36.478 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:36 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:04:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:04:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi029 2024-09-21T07:04:36.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi029 to 5697M 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:36.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] boot 2024-09-21T07:04:36.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T07:04:36.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:36 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:36.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:04:36.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi029 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi029 to 5697M 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:36.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:36.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:04:36.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:04:36.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:36.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: osd.6 [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] boot 2024-09-21T07:04:36.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T07:04:36.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:36 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T07:04:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:37 smithi052 ceph-mon[34308]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:37 smithi052 ceph-mon[34308]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:37 smithi052 ceph-mon[34308]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T07:04:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:37 smithi066 ceph-mon[34793]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:37 smithi066 ceph-mon[34793]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:37 smithi066 ceph-mon[34793]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T07:04:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:37 smithi029 ceph-mon[30983]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:04:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:37 smithi029 ceph-mon[30983]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-21T07:04:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:37 smithi029 ceph-mon[30983]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T07:04:38.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:38 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/4104552791' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"} : dispatch 2024-09-21T07:04:38.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:38 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"} : dispatch 2024-09-21T07:04:38.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:38 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"}]': finished 2024-09-21T07:04:38.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:38 smithi052 ceph-mon[34308]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:04:38.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:04:38.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:38 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/4104552791' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"} : dispatch 2024-09-21T07:04:38.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:38 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"} : dispatch 2024-09-21T07:04:38.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:38 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"}]': finished 2024-09-21T07:04:38.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:38 smithi066 ceph-mon[34793]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:04:38.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:04:38.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:38 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/4104552791' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"} : dispatch 2024-09-21T07:04:38.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:38 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"} : dispatch 2024-09-21T07:04:38.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:38 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54a8f327-cf53-4753-8b91-a19aa92fd237"}]': finished 2024-09-21T07:04:38.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:38 smithi029 ceph-mon[30983]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T07:04:38.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:04:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:39 smithi066 ceph-mon[34793]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:39 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/961003568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:04:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:39 smithi029 ceph-mon[30983]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:39 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/961003568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:04:39.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:39 smithi052 ceph-mon[34308]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:39.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:39 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/961003568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:04:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:41 smithi066 ceph-mon[34793]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:41 smithi029 ceph-mon[30983]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:41 smithi052 ceph-mon[34308]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:43 smithi052 ceph-mon[34308]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:43.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:43 smithi066 ceph-mon[34793]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:43 smithi029 ceph-mon[30983]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:45.770 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:45 smithi052 ceph-mon[34308]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:45 smithi066 ceph-mon[34793]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:45.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:45 smithi029 ceph-mon[30983]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:47.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:47 smithi052 ceph-mon[34308]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:47.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:47 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:04:47.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:47 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:47 smithi066 ceph-mon[34793]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:47 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:04:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:47 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:47.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:47 smithi029 ceph-mon[30983]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:47.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:47 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T07:04:47.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:47 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:48.735 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:48 smithi052 ceph-mon[34308]: Deploying daemon osd.7 on smithi052 2024-09-21T07:04:48.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:48 smithi066 ceph-mon[34793]: Deploying daemon osd.7 on smithi052 2024-09-21T07:04:48.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:48 smithi029 ceph-mon[30983]: Deploying daemon osd.7 on smithi052 2024-09-21T07:04:49.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:49 smithi052 ceph-mon[34308]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:49.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:49 smithi066 ceph-mon[34793]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:49 smithi029 ceph-mon[30983]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:51 smithi066 ceph-mon[34793]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:51 smithi029 ceph-mon[30983]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:51.889 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:51 smithi052 ceph-mon[34308]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:53 smithi052 ceph-mon[34308]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:53 smithi066 ceph-mon[34793]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:53 smithi029 ceph-mon[30983]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:55 smithi066 ceph-mon[34793]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:55 smithi029 ceph-mon[30983]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.893 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:55 smithi052 ceph-mon[34308]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:55.893 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.893 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:55.893 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:04:55.893 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:04:55.893 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:56.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.519+0000 7fe7d5ffb640 1 -- 172.21.15.52:0/1762654690 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe7d806b570 con 0x7fe7c40b6510 2024-09-21T07:04:56.521 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 7 on host 'smithi052' 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe7c40b6510 msgr2=0x7fe7c40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe7c40b6510 0x7fe7c40b8a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0000c00 tx=0x7fe7c0031400 comp rx=0 tx=0).stop 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d81036d0 msgr2=0x7fe7d819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d81036d0 0x7fe7d819a610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800eab0 tx=0x7fe7c800ef70 comp rx=0 tx=0).stop 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 shutdown_connections 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe7c40b6510 0x7fe7c40b8a20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7d8104070 0x7fe7d819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d81036d0 0x7fe7d819a610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 --2- 172.21.15.52:0/1762654690 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7d8102640 0x7fe7d8199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 >> 172.21.15.52:0/1762654690 conn(0x7fe7d80fdfb0 msgr2=0x7fe7d806ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:04:56.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 shutdown_connections 2024-09-21T07:04:56.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:04:56.521+0000 7fe7df159640 1 -- 172.21.15.52:0/1762654690 wait complete. 2024-09-21T07:04:56.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:56.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:56.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:56.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:56.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:04:56.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:56.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:04:57.149 DEBUG:teuthology.orchestra.run.smithi052:osd.7> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T07:04:57.151 INFO:tasks.cephadm:Deploying osd.8 on smithi066 with /dev/vg_nvme/lv_2... 2024-09-21T07:04:57.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T07:04:57.417 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:04:57.842 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:57 smithi066 ceph-mon[34793]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:57 smithi029 ceph-mon[30983]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:57 smithi052 ceph-mon[34308]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:58.585 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:04:58 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:04:58.423+0000 7f558d99f640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:04:58.712 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:58 smithi066 ceph-mon[34793]: from='osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:04:58.712 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:58 smithi066 ceph-mon[34793]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:04:58.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:58 smithi029 ceph-mon[30983]: from='osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:04:58.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:58 smithi029 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:04:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:58 smithi052 ceph-mon[34308]: from='osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:04:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:58 smithi052 ceph-mon[34308]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T07:04:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:59 smithi066 ceph-mon[34793]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:59 smithi066 ceph-mon[34793]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:04:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:59 smithi066 ceph-mon[34793]: from='osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:04:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:59 smithi066 ceph-mon[34793]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:04:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:04:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:04:59 smithi066 ceph-mon[34793]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:04:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:59 smithi029 ceph-mon[30983]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:59 smithi029 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:04:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:59 smithi029 ceph-mon[30983]: from='osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:04:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:59 smithi029 ceph-mon[30983]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:04:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:04:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:04:59 smithi029 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:04:59.881 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:04:59.908 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi066:vg_nvme/lv_2 2024-09-21T07:04:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-mon[34308]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:04:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-mon[34308]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T07:04:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-mon[34308]: from='osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:04:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-mon[34308]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T07:04:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:04:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-mon[34308]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:04:59.993 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:04:59.597+0000 7f5589921640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:04:59.994 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:04:59 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:04:59.610+0000 7f558571f640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:05:00.175 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:05:00.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 -- 172.21.15.66:0/2627571878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a8103700 msgr2=0x7fa2a8103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/2627571878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a8103700 0x7fa2a8103b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa294009900 tx=0x7fa29402a480 comp rx=0 tx=0).stop 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 -- 172.21.15.66:0/2627571878 shutdown_connections 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/2627571878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a81040a0 0x7fa2a810aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/2627571878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a8103700 0x7fa2a8103b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/2627571878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a8102670 0x7fa2a8102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 -- 172.21.15.66:0/2627571878 >> 172.21.15.66:0/2627571878 conn(0x7fa2a80fdfe0 msgr2=0x7fa2a8100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 -- 172.21.15.66:0/2627571878 shutdown_connections 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 -- 172.21.15.66:0/2627571878 wait complete. 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 Processor -- start 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.734+0000 7fa2aeb89640 1 -- start start 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2aeb89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a8102670 0x7fa2a819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2aeb89640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8103700 0x7fa2a819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:00.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2aeb89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a81040a0 0x7fa2a819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2aeb89640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a810e2a0 con 0x7fa2a8103700 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2aeb89640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a810e120 con 0x7fa2a8102670 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2aeb89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a810e420 con 0x7fa2a81040a0 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a81040a0 0x7fa2a819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a81040a0 0x7fa2a819b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:34690/0 (socket says 172.21.15.66:34690) 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 -- 172.21.15.66:0/285011260 learned_addr learned my addr 172.21.15.66:0/285011260 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ac925640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a8102670 0x7fa2a819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2a7fff640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8103700 0x7fa2a819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 -- 172.21.15.66:0/285011260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a8102670 msgr2=0x7fa2a819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a8102670 0x7fa2a819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 -- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8103700 msgr2=0x7fa2a819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8103700 0x7fa2a819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:00.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 -- 172.21.15.66:0/285011260 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a819bb00 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.735+0000 7fa2ad126640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a81040a0 0x7fa2a819b2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000cad0 tx=0x7fa2a000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.736+0000 7fa2a5ffb640 1 -- 172.21.15.66:0/285011260 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000ae20 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.736+0000 7fa2a5ffb640 1 -- 172.21.15.66:0/285011260 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2a0005020 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.736+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a819bdf0 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.736+0000 7fa2a5ffb640 1 -- 172.21.15.66:0/285011260 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000f6b0 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.736+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a81a24f0 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.737+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a81a26c0 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.739+0000 7fa2a5ffb640 1 -- 172.21.15.66:0/285011260 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa2a00051d0 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.739+0000 7fa2a5ffb640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa2980b6510 0x7fa2980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.740+0000 7fa2a5ffb640 1 -- 172.21.15.66:0/285011260 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5430+0+0 (secure 0 0 0) 0x7fa2a00e6b60 con 0x7fa2a81040a0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.740+0000 7fa2ac925640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa2980b6510 0x7fa2980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.740+0000 7fa2ac925640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa2980b6510 0x7fa2980b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00bbe0 tx=0x7fa29c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:00.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.743+0000 7fa2a5ffb640 1 -- 172.21.15.66:0/285011260 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2a0014030 con 0x7fa2a81040a0 2024-09-21T07:05:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:05:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:05:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:05:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:05:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:00.940+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa2a8100030 con 0x7fa2980b6510 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:00.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:00.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:00.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:00.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:05:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:05:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:05:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi052 2024-09-21T07:05:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-21T07:05:01.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:01.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] boot 2024-09-21T07:05:01.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T07:05:01.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:01.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:01.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:01.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi052 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] boot 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T07:05:01.970 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:01.971 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:01.971 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:01.971 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi052 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: osd.7 [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] boot 2024-09-21T07:05:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T07:05:01.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T07:05:01.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:01.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:01.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:02.848 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:02 smithi066 ceph-mon[34793]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:02.848 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:02 smithi066 ceph-mon[34793]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T07:05:02.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:02 smithi029 ceph-mon[30983]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:02.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:02 smithi029 ceph-mon[30983]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T07:05:02.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:02 smithi052 ceph-mon[34308]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:02.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:02 smithi052 ceph-mon[34308]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T07:05:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:03 smithi029 ceph-mon[30983]: pgmap v189: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:03 smithi029 ceph-mon[30983]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:05:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:03 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/3918529938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"} : dispatch 2024-09-21T07:05:03.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:03 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"} : dispatch 2024-09-21T07:05:03.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:03 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"}]': finished 2024-09-21T07:05:03.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:03 smithi029 ceph-mon[30983]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:05:03.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:03 smithi052 ceph-mon[34308]: pgmap v189: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:03 smithi052 ceph-mon[34308]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:05:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:03 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/3918529938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"} : dispatch 2024-09-21T07:05:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:03 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"} : dispatch 2024-09-21T07:05:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:03 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"}]': finished 2024-09-21T07:05:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:03 smithi052 ceph-mon[34308]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:05:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:04.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:03 smithi066 ceph-mon[34793]: pgmap v189: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:04.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:03 smithi066 ceph-mon[34793]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T07:05:04.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:03 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/3918529938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"} : dispatch 2024-09-21T07:05:04.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:03 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"} : dispatch 2024-09-21T07:05:04.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:03 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5542b251-2218-4751-bee7-006dfa5ce8e8"}]': finished 2024-09-21T07:05:04.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:03 smithi066 ceph-mon[34793]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T07:05:04.034 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:04.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:04 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/251444101' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:05.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:04 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/251444101' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:04 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/251444101' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:05.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:05 smithi052 ceph-mon[34308]: pgmap v192: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:06.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:05 smithi066 ceph-mon[34793]: pgmap v192: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:06.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:05 smithi029 ceph-mon[30983]: pgmap v192: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:07.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:07 smithi052 ceph-mon[34308]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:08.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:07 smithi066 ceph-mon[34793]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:08.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:07 smithi029 ceph-mon[30983]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:09 smithi066 ceph-mon[34793]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 182 KiB/s, 0 objects/s recovering 2024-09-21T07:05:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:09 smithi052 ceph-mon[34308]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 182 KiB/s, 0 objects/s recovering 2024-09-21T07:05:10.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:09 smithi029 ceph-mon[30983]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 182 KiB/s, 0 objects/s recovering 2024-09-21T07:05:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:11 smithi066 ceph-mon[34793]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T07:05:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:11 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:05:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:11 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:11 smithi052 ceph-mon[34308]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T07:05:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:11 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:05:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:11 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:12.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:11 smithi029 ceph-mon[30983]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T07:05:12.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T07:05:12.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:11 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:12.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:12 smithi029 ceph-mon[30983]: Deploying daemon osd.8 on smithi066 2024-09-21T07:05:12.991 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:12 smithi066 ceph-mon[34793]: Deploying daemon osd.8 on smithi066 2024-09-21T07:05:12.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:12 smithi052 ceph-mon[34308]: Deploying daemon osd.8 on smithi066 2024-09-21T07:05:13.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:13 smithi066 ceph-mon[34793]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-21T07:05:13.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:13 smithi052 ceph-mon[34308]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-21T07:05:14.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:13 smithi029 ceph-mon[30983]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-21T07:05:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:15 smithi052 ceph-mon[34308]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-21T07:05:16.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:15 smithi066 ceph-mon[34793]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-21T07:05:16.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:15 smithi029 ceph-mon[30983]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-21T07:05:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:17 smithi052 ceph-mon[34308]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:05:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:17 smithi066 ceph-mon[34793]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:05:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:17 smithi029 ceph-mon[30983]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:05:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:19.977 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:19 smithi066 ceph-mon[34793]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:05:19.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:19 smithi052 ceph-mon[34308]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:05:20.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:19 smithi029 ceph-mon[30983]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:05:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:21 smithi066 ceph-mon[34793]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:21 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:21 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:21 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:21 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:21 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.418+0000 7fa2a5ffb640 1 -- 172.21.15.66:0/285011260 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa2a8100030 con 0x7fa2980b6510 2024-09-21T07:05:21.421 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 8 on host 'smithi066' 2024-09-21T07:05:21.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa2980b6510 msgr2=0x7fa2980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa2980b6510 0x7fa2980b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00bbe0 tx=0x7fa29c00b390 comp rx=0 tx=0).stop 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a81040a0 msgr2=0x7fa2a819b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a81040a0 0x7fa2a819b2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000cad0 tx=0x7fa2a000cf90 comp rx=0 tx=0).stop 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 shutdown_connections 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa2980b6510 0x7fa2980b8a20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a81040a0 0x7fa2a819b2e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2a8103700 0x7fa2a819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 --2- 172.21.15.66:0/285011260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2a8102670 0x7fa2a819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 >> 172.21.15.66:0/285011260 conn(0x7fa2a80fdfe0 msgr2=0x7fa2a80ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 shutdown_connections 2024-09-21T07:05:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:05:21.421+0000 7fa2aeb89640 1 -- 172.21.15.66:0/285011260 wait complete. 2024-09-21T07:05:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:21 smithi052 ceph-mon[34308]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:21 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:21 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:21 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:21 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:21 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:21 smithi029 ceph-mon[30983]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:21 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:21 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:21 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:21 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:21.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:21 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:22.021 DEBUG:teuthology.orchestra.run.smithi066:osd.8> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T07:05:22.024 INFO:tasks.cephadm:Deploying osd.9 on smithi029 with /dev/vg_nvme/lv_1... 2024-09-21T07:05:22.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:05:22.295 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:22.521 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:22.521 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:22.521 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:22.580 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:22.581 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:22.581 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:22.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:22.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:22.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:23.451 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:23 smithi066 ceph-mon[34793]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:23 smithi052 ceph-mon[34308]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:23.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:23 smithi029 ceph-mon[30983]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:23.851 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:05:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:05:23.527+0000 7f5ef6a4b640 -1 osd.8 0 log_to_monitors true 2024-09-21T07:05:24.547 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:24 smithi066 ceph-mon[34793]: from='osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:05:24.547 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:24 smithi066 ceph-mon[34793]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:05:24.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:24 smithi029 ceph-mon[30983]: from='osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:05:24.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:24 smithi029 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:05:24.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:24 smithi052 ceph-mon[34308]: from='osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:05:24.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:24 smithi052 ceph-mon[34308]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T07:05:25.226 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:05:25.251 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi029:vg_nvme/lv_1 2024-09-21T07:05:25.510 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:05:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:05:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:05:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:25.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:25 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:25.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:25 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.851 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:05:25.427+0000 7f5ef29cd640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T07:05:25.851 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:05:25.440+0000 7f5eee7cb640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:05:25.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:25.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:25.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:25.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:25 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.998+0000 7f542edb2640 1 -- 172.21.15.29:0/238416441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5428103700 msgr2=0x7f5428103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.998+0000 7f542edb2640 1 --2- 172.21.15.29:0/238416441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5428103700 0x7f5428103b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5418009ca0 tx=0x7f541802a950 comp rx=0 tx=0).stop 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 -- 172.21.15.29:0/238416441 shutdown_connections 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 --2- 172.21.15.29:0/238416441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54281040a0 0x7f542810aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 --2- 172.21.15.29:0/238416441 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5428103700 0x7f5428103b10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 --2- 172.21.15.29:0/238416441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5428102670 0x7f5428102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 -- 172.21.15.29:0/238416441 >> 172.21.15.29:0/238416441 conn(0x7f54280fdfe0 msgr2=0x7f5428100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:26.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 -- 172.21.15.29:0/238416441 shutdown_connections 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 -- 172.21.15.29:0/238416441 wait complete. 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 Processor -- start 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:25.999+0000 7f542edb2640 1 -- start start 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542edb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5428102670 0x7f5428106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542edb2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5428103700 0x7f5428104b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542edb2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54281040a0 0x7f5428105050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542edb2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f542810e2f0 con 0x7f54281040a0 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542edb2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f542810e170 con 0x7f5428102670 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542edb2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f542810e470 con 0x7f5428103700 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54281040a0 0x7f5428105050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54281040a0 0x7f5428105050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49268/0 (socket says 172.21.15.29:49268) 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 -- 172.21.15.29:0/2496116689 learned_addr learned my addr 172.21.15.29:0/2496116689 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542cb4e640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5428102670 0x7f5428106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f5427fff640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5428103700 0x7f5428104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 -- 172.21.15.29:0/2496116689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5428103700 msgr2=0x7f5428104b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5428103700 0x7f5428104b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 -- 172.21.15.29:0/2496116689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5428102670 msgr2=0x7f5428106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5428102670 0x7f5428106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 -- 172.21.15.29:0/2496116689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54281056c0 con 0x7f54281040a0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542d34f640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54281040a0 0x7f5428105050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f542000c970 tx=0x7f542000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f5425ffb640 1 -- 172.21.15.29:0/2496116689 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420007bb0 con 0x7f54281040a0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f5425ffb640 1 -- 172.21.15.29:0/2496116689 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5420007d50 con 0x7f54281040a0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.000+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54281a4090 con 0x7f54281040a0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.001+0000 7f5425ffb640 1 -- 172.21.15.29:0/2496116689 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420018770 con 0x7f54281040a0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.001+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281a4430 con 0x7f54281040a0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.002+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5428102ae0 con 0x7f54281040a0 2024-09-21T07:05:26.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.003+0000 7f5425ffb640 1 -- 172.21.15.29:0/2496116689 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f542000f990 con 0x7f54281040a0 2024-09-21T07:05:26.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.004+0000 7f5425ffb640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f54140b6510 0x7f54140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:26.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.004+0000 7f542cb4e640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f54140b6510 0x7f54140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:26.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.004+0000 7f5425ffb640 1 -- 172.21.15.29:0/2496116689 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7f54200e6900 con 0x7f54281040a0 2024-09-21T07:05:26.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.005+0000 7f542cb4e640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f54140b6510 0x7f54140b8a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f541000bbe0 tx=0x7f541000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:26.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.009+0000 7f5425ffb640 1 -- 172.21.15.29:0/2496116689 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5420014030 con 0x7f54281040a0 2024-09-21T07:05:26.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:26.207+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f54281a46f0 con 0x7f54140b6510 2024-09-21T07:05:26.597 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi066 2024-09-21T07:05:26.597 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-21T07:05:26.597 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:05:26.597 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:05:26.597 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:26.597 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:26.598 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:26.598 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:26.598 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi066 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:26.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi066 2024-09-21T07:05:26.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi066 to 5696M 2024-09-21T07:05:26.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:05:26.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T07:05:26.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:26.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:26.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:26.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:26.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:05:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:05:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:27.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] boot 2024-09-21T07:05:27.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T07:05:27.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:27.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:27 smithi029 ceph-mon[30983]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:05:27.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:05:27.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:05:27.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:27.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:27.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:27.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] boot 2024-09-21T07:05:27.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T07:05:27.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:27.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:27 smithi052 ceph-mon[34308]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:05:27.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:05:27.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:05:27.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-09-21T07:05:27.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:27.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:27.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: osd.8 [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] boot 2024-09-21T07:05:27.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T07:05:27.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T07:05:27.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:27 smithi066 ceph-mon[34793]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T07:05:28.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:28 smithi029 ceph-mon[30983]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:05:28.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:28 smithi029 ceph-mon[30983]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:29.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:28 smithi066 ceph-mon[34793]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:05:29.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:28 smithi066 ceph-mon[34793]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:29.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:28 smithi052 ceph-mon[34308]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T07:05:29.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:28 smithi052 ceph-mon[34308]: pgmap v209: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:29 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2342720471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2be711e7-2f39-4acb-bb4b-c8cbfdfa9909"} : dispatch 2024-09-21T07:05:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:29 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2342720471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2be711e7-2f39-4acb-bb4b-c8cbfdfa9909"}]': finished 2024-09-21T07:05:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:29 smithi066 ceph-mon[34793]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:05:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:29 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:29 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4117712466' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:30.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:29 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2342720471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2be711e7-2f39-4acb-bb4b-c8cbfdfa9909"} : dispatch 2024-09-21T07:05:30.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:29 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2342720471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2be711e7-2f39-4acb-bb4b-c8cbfdfa9909"}]': finished 2024-09-21T07:05:30.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:29 smithi029 ceph-mon[30983]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:05:30.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:29 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:30.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:29 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4117712466' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:29 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2342720471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2be711e7-2f39-4acb-bb4b-c8cbfdfa9909"} : dispatch 2024-09-21T07:05:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:29 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2342720471' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2be711e7-2f39-4acb-bb4b-c8cbfdfa9909"}]': finished 2024-09-21T07:05:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:29 smithi052 ceph-mon[34308]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T07:05:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:29 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:29 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4117712466' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:31.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:30 smithi066 ceph-mon[34793]: pgmap v211: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:31.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:30 smithi029 ceph-mon[30983]: pgmap v211: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:31.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:30 smithi052 ceph-mon[34308]: pgmap v211: 1 pgs: 1 remapped+peering; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:33.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:33 smithi066 ceph-mon[34793]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-21T07:05:33.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:33 smithi029 ceph-mon[30983]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-21T07:05:33.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:33 smithi052 ceph-mon[34308]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-21T07:05:35.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:35 smithi066 ceph-mon[34793]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T07:05:35.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:35 smithi029 ceph-mon[30983]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T07:05:35.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:35 smithi052 ceph-mon[34308]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-21T07:05:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:37 smithi066 ceph-mon[34793]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:05:37.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:37 smithi029 ceph-mon[30983]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:05:37.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:37 smithi052 ceph-mon[34308]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T07:05:38.271 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:05:38.271 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:38 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:38.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:05:38.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:38 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:38.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T07:05:38.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:38 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:39.234 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:39 smithi029 ceph-mon[30983]: Deploying daemon osd.9 on smithi029 2024-09-21T07:05:39.234 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:39 smithi029 ceph-mon[30983]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:05:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:39 smithi066 ceph-mon[34793]: Deploying daemon osd.9 on smithi029 2024-09-21T07:05:39.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:39 smithi066 ceph-mon[34793]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:05:39.394 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:39 smithi052 ceph-mon[34308]: Deploying daemon osd.9 on smithi029 2024-09-21T07:05:39.394 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:39 smithi052 ceph-mon[34308]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T07:05:41.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:41 smithi066 ceph-mon[34793]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:05:41.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:41 smithi029 ceph-mon[30983]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:05:41.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:41 smithi052 ceph-mon[34308]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T07:05:43.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:43 smithi066 ceph-mon[34793]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:05:43.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:43 smithi029 ceph-mon[30983]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:05:43.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:43 smithi052 ceph-mon[34308]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:05:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:44 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:44.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:44.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:44.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:44 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:44.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:44.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:44.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:44 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:45.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:45 smithi066 ceph-mon[34793]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:45.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:45 smithi029 ceph-mon[30983]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:45.492 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:45 smithi052 ceph-mon[34308]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:47.257 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:47 smithi029 ceph-mon[30983]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:47.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:47 smithi066 ceph-mon[34793]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:47.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:47 smithi052 ceph-mon[34308]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:47.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.612+0000 7f5425ffb640 1 -- 172.21.15.29:0/2496116689 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f54281a46f0 con 0x7f54140b6510 2024-09-21T07:05:47.614 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 9 on host 'smithi029' 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f54140b6510 msgr2=0x7f54140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f54140b6510 0x7f54140b8a20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f541000bbe0 tx=0x7f541000b390 comp rx=0 tx=0).stop 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54281040a0 msgr2=0x7f5428105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54281040a0 0x7f5428105050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f542000c970 tx=0x7f542000ce30 comp rx=0 tx=0).stop 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 shutdown_connections 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f54140b6510 0x7f54140b8a20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54281040a0 0x7f5428105050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5428103700 0x7f5428104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 --2- 172.21.15.29:0/2496116689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5428102670 0x7f5428106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 >> 172.21.15.29:0/2496116689 conn(0x7f54280fdfe0 msgr2=0x7f54280ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 shutdown_connections 2024-09-21T07:05:47.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:05:47.615+0000 7f542edb2640 1 -- 172.21.15.29:0/2496116689 wait complete. 2024-09-21T07:05:48.290 DEBUG:teuthology.orchestra.run.smithi029:osd.9> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T07:05:48.293 INFO:tasks.cephadm:Deploying osd.10 on smithi052 with /dev/vg_nvme/lv_1... 2024-09-21T07:05:48.293 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:05:48.557 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:05:48.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:48.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:48.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:48.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:48 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:48.910 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:48.910 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:48.910 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:48.910 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:48 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:49.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:49.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:49.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:49.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:48 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:49 smithi029 ceph-mon[30983]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:49.935 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:49 smithi052 ceph-mon[34308]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:49 smithi066 ceph-mon[34793]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:50.615 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:05:50 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:05:50.334+0000 7f10b8a5d640 -1 osd.9 0 log_to_monitors true 2024-09-21T07:05:50.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:50 smithi052 ceph-mon[34308]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:05:50.858 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:50 smithi029 ceph-mon[30983]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:05:51.033 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:50 smithi066 ceph-mon[34793]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T07:05:51.219 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-21T07:05:51.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi052:vg_nvme/lv_1 2024-09-21T07:05:51.505 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:05:51.735 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:51 smithi052 ceph-mon[34308]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:51.735 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:51 smithi052 ceph-mon[34308]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:05:51.735 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:51 smithi052 ceph-mon[34308]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:05:51.735 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:51 smithi052 ceph-mon[34308]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:05:51.735 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:51.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 -- 172.21.15.52:0/1061808222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d41068d0 msgr2=0x7ff3d4108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 --2- 172.21.15.52:0/1061808222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d41068d0 0x7ff3d4108d30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009900 tx=0x7ff3c802a410 comp rx=0 tx=0).stop 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 -- 172.21.15.52:0/1061808222 shutdown_connections 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 --2- 172.21.15.52:0/1061808222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3d4109470 0x7ff3d410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 --2- 172.21.15.52:0/1061808222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d41068d0 0x7ff3d4108d30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 --2- 172.21.15.52:0/1061808222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3d406c6c0 0x7ff3d4106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 -- 172.21.15.52:0/1061808222 >> 172.21.15.52:0/1061808222 conn(0x7ff3d40fdfb0 msgr2=0x7ff3d4100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 -- 172.21.15.52:0/1061808222 shutdown_connections 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 -- 172.21.15.52:0/1061808222 wait complete. 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.962+0000 7ff3da370640 1 Processor -- start 2024-09-21T07:05:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3da370640 1 -- start start 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3da370640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d406c6c0 0x7ff3d4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3da370640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3d41068d0 0x7ff3d419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3da370640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3d4109470 0x7ff3d419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3da370640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d410f360 con 0x7ff3d41068d0 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3da370640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d410f1e0 con 0x7ff3d406c6c0 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3da370640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d410f4e0 con 0x7ff3d4109470 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d406c6c0 0x7ff3d4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d406c6c0 0x7ff3d4199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39602/0 (socket says 172.21.15.52:39602) 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 -- 172.21.15.52:0/2394811191 learned_addr learned my addr 172.21.15.52:0/2394811191 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d37fe640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3d41068d0 0x7ff3d419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d890d640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3d4109470 0x7ff3d419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 -- 172.21.15.52:0/2394811191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3d4109470 msgr2=0x7ff3d419b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3d4109470 0x7ff3d419b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 -- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3d41068d0 msgr2=0x7ff3d419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3d41068d0 0x7ff3d419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.963+0000 7ff3d3fff640 1 -- 172.21.15.52:0/2394811191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d419ba20 con 0x7ff3d406c6c0 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.964+0000 7ff3d3fff640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d406c6c0 0x7ff3d4199ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d950 tx=0x7ff3c400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.964+0000 7ff3d17fa640 1 -- 172.21.15.52:0/2394811191 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4017030 con 0x7ff3d406c6c0 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.964+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d419bd10 con 0x7ff3d406c6c0 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.964+0000 7ff3d17fa640 1 -- 172.21.15.52:0/2394811191 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c4004020 con 0x7ff3d406c6c0 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.964+0000 7ff3d17fa640 1 -- 172.21.15.52:0/2394811191 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40047a0 con 0x7ff3d406c6c0 2024-09-21T07:05:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.964+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d41a2410 con 0x7ff3d406c6c0 2024-09-21T07:05:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.965+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d40ffad0 con 0x7ff3d406c6c0 2024-09-21T07:05:51.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.967+0000 7ff3d17fa640 1 -- 172.21.15.52:0/2394811191 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff3c4009a30 con 0x7ff3d406c6c0 2024-09-21T07:05:51.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.968+0000 7ff3d17fa640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff3bc0b6590 0x7ff3bc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:05:51.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.968+0000 7ff3d17fa640 1 -- 172.21.15.52:0/2394811191 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5981+0+0 (secure 0 0 0) 0x7ff3c40e6b30 con 0x7ff3d406c6c0 2024-09-21T07:05:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.969+0000 7ff3d37fe640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff3bc0b6590 0x7ff3bc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:05:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.969+0000 7ff3d37fe640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff3bc0b6590 0x7ff3bc0b8aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8000c00 tx=0x7ff3c8031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:05:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:51.972+0000 7ff3d17fa640 1 -- 172.21.15.52:0/2394811191 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3c40adcc0 con 0x7ff3d406c6c0 2024-09-21T07:05:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:51 smithi066 ceph-mon[34793]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:51 smithi066 ceph-mon[34793]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:05:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:51 smithi066 ceph-mon[34793]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:05:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:51 smithi066 ceph-mon[34793]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:05:52.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:51 smithi029 ceph-mon[30983]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:51 smithi029 ceph-mon[30983]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T07:05:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:51 smithi029 ceph-mon[30983]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T07:05:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:51 smithi029 ceph-mon[30983]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]} : dispatch 2024-09-21T07:05:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:52.121 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:05:51 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:05:51.630+0000 7f10b49df640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T07:05:52.122 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:05:51 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:05:51.648+0000 7f10b07dd640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:05:52.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:05:52.170+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff3d4063800 con 0x7ff3bc0b6590 2024-09-21T07:05:52.872 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:05:52.873 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:05:52.873 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:52.873 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:52.873 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi029 2024-09-21T07:05:52.873 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:52.873 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:52.873 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:52.874 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:52.874 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:52.874 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:52.874 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi029 to 4273M 2024-09-21T07:05:52.874 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:52.875 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:52.875 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:52.875 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:52.875 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:52.875 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:52.875 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:52.875 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:52.876 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:52.876 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:52.876 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:05:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:05:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi029 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi029 to 4273M 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:53.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:53.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:53.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-21T07:05:53.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi029 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi029 to 4273M 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:53.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:05:53.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:05:53.862 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:53 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:05:53.862 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:53 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:05:53.862 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:53 smithi052 ceph-mon[34308]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:53.862 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:53 smithi052 ceph-mon[34308]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:53.863 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:53 smithi052 ceph-mon[34308]: osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] boot 2024-09-21T07:05:53.863 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:53 smithi052 ceph-mon[34308]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T07:05:53.863 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:53 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:05:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:53 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:05:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:53 smithi066 ceph-mon[34793]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:53 smithi066 ceph-mon[34793]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:53 smithi066 ceph-mon[34793]: osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] boot 2024-09-21T07:05:54.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:53 smithi066 ceph-mon[34793]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T07:05:54.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:53 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:05:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:53 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:05:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:53 smithi029 ceph-mon[30983]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-21T07:05:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:53 smithi029 ceph-mon[30983]: from='client.24512 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:05:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:53 smithi029 ceph-mon[30983]: osd.9 [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] boot 2024-09-21T07:05:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:53 smithi029 ceph-mon[30983]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T07:05:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T07:05:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:54 smithi066 ceph-mon[34793]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:05:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:54 smithi066 ceph-mon[34793]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:54 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/933499834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"} : dispatch 2024-09-21T07:05:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:54 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"} : dispatch 2024-09-21T07:05:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:54 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"}]': finished 2024-09-21T07:05:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:54 smithi066 ceph-mon[34793]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:05:55.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:05:55.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:54 smithi029 ceph-mon[30983]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:05:55.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:54 smithi029 ceph-mon[30983]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:55.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:54 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/933499834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"} : dispatch 2024-09-21T07:05:55.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:54 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"} : dispatch 2024-09-21T07:05:55.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:54 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"}]': finished 2024-09-21T07:05:55.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:54 smithi029 ceph-mon[30983]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:05:55.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:05:55.212 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:54 smithi052 ceph-mon[34308]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T07:05:55.212 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:54 smithi052 ceph-mon[34308]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:55.212 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:54 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/933499834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"} : dispatch 2024-09-21T07:05:55.213 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:54 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"} : dispatch 2024-09-21T07:05:55.213 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:54 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe637203-8937-4364-b1d8-010c5f1f238c"}]': finished 2024-09-21T07:05:55.213 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:54 smithi052 ceph-mon[34308]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T07:05:55.213 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:05:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:55 smithi066 ceph-mon[34793]: from='client.? 172.21.15.52:0/2597376212' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:55 smithi029 ceph-mon[30983]: from='client.? 172.21.15.52:0/2597376212' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:55 smithi052 ceph-mon[34308]: from='client.? 172.21.15.52:0/2597376212' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:05:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:56 smithi066 ceph-mon[34793]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:57.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:56 smithi029 ceph-mon[30983]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:56 smithi052 ceph-mon[34308]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:05:59 smithi066 ceph-mon[34793]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:05:59 smithi029 ceph-mon[30983]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:05:59.483 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:05:59 smithi052 ceph-mon[34308]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:01.213 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:01 smithi052 ceph-mon[34308]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:01.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:01 smithi029 ceph-mon[30983]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:01 smithi066 ceph-mon[34793]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:03 smithi066 ceph-mon[34793]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:03.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:03 smithi029 ceph-mon[30983]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:03.492 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:03 smithi052 ceph-mon[34308]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:04.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:06:04.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:04.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:04 smithi052 ceph-mon[34308]: Deploying daemon osd.10 on smithi052 2024-09-21T07:06:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:06:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:04 smithi066 ceph-mon[34793]: Deploying daemon osd.10 on smithi052 2024-09-21T07:06:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T07:06:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:04 smithi029 ceph-mon[30983]: Deploying daemon osd.10 on smithi052 2024-09-21T07:06:05.133 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:05 smithi052 ceph-mon[34308]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:05.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:05 smithi066 ceph-mon[34793]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:05.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:05 smithi029 ceph-mon[30983]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:07.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:07 smithi052 ceph-mon[34308]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:07.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:07 smithi066 ceph-mon[34793]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:07.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:07 smithi029 ceph-mon[30983]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:09.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:09 smithi052 ceph-mon[34308]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:09.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:09 smithi066 ceph-mon[34793]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:09.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:09 smithi029 ceph-mon[30983]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:10.181 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:10.181 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:10.181 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:10.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:10.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:10.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:10.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:10.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:10.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:11.175 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:11 smithi052 ceph-mon[34308]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:11.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:11 smithi066 ceph-mon[34793]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:11.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:11 smithi029 ceph-mon[30983]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:12.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.792+0000 7ff3d17fa640 1 -- 172.21.15.52:0/2394811191 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff3d4063800 con 0x7ff3bc0b6590 2024-09-21T07:06:12.795 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 10 on host 'smithi052' 2024-09-21T07:06:12.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff3bc0b6590 msgr2=0x7ff3bc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff3bc0b6590 0x7ff3bc0b8aa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8000c00 tx=0x7ff3c8031400 comp rx=0 tx=0).stop 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d406c6c0 msgr2=0x7ff3d4199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d406c6c0 0x7ff3d4199ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400d950 tx=0x7ff3c400de10 comp rx=0 tx=0).stop 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 shutdown_connections 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff3bc0b6590 0x7ff3bc0b8aa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3d4109470 0x7ff3d419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3d41068d0 0x7ff3d419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 --2- 172.21.15.52:0/2394811191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d406c6c0 0x7ff3d4199ff0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 >> 172.21.15.52:0/2394811191 conn(0x7ff3d40fdfb0 msgr2=0x7ff3d4104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:12.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 shutdown_connections 2024-09-21T07:06:12.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-21T07:06:12.795+0000 7ff3da370640 1 -- 172.21.15.52:0/2394811191 wait complete. 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:13 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:13.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:13.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:13.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:13.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:13 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.386 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:13.386 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.386 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.386 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:13.386 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:13.386 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.387 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:13.387 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.387 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:13 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:13.412 DEBUG:teuthology.orchestra.run.smithi052:osd.10> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T07:06:13.414 INFO:tasks.cephadm:Deploying osd.11 on smithi066 with /dev/vg_nvme/lv_1... 2024-09-21T07:06:13.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T07:06:13.682 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:06:15.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:15 smithi066 ceph-mon[34793]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:15.230 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:15 smithi052 ceph-mon[34308]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:15.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:15 smithi029 ceph-mon[30983]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:15.493 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:06:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:06:15.227+0000 7f7b6242b640 -1 osd.10 0 log_to_monitors true 2024-09-21T07:06:16.218 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:16 smithi066 ceph-mon[34793]: from='osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:06:16.218 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:16 smithi066 ceph-mon[34793]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:06:16.221 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-21T07:06:16.233 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:16 smithi052 ceph-mon[34308]: from='osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:06:16.233 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:16 smithi052 ceph-mon[34308]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:06:16.248 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi066:vg_nvme/lv_1 2024-09-21T07:06:16.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:16 smithi029 ceph-mon[30983]: from='osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:06:16.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:16 smithi029 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T07:06:16.513 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:06:16.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.966+0000 7f508b1e5640 1 -- 172.21.15.66:0/231844893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084104870 msgr2=0x7f5084104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.966+0000 7f508b1e5640 1 --2- 172.21.15.66:0/231844893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084104870 0x7f5084104c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5070009900 tx=0x7f507002a480 comp rx=0 tx=0).stop 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.966+0000 7f508b1e5640 1 -- 172.21.15.66:0/231844893 shutdown_connections 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.966+0000 7f508b1e5640 1 --2- 172.21.15.66:0/231844893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5084105210 0x7f508410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.966+0000 7f508b1e5640 1 --2- 172.21.15.66:0/231844893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084104870 0x7f5084104c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.966+0000 7f508b1e5640 1 --2- 172.21.15.66:0/231844893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50841037e0 0x7f5084103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.966+0000 7f508b1e5640 1 -- 172.21.15.66:0/231844893 >> 172.21.15.66:0/231844893 conn(0x7f50840ff150 msgr2=0x7f5084101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.967+0000 7f508b1e5640 1 -- 172.21.15.66:0/231844893 shutdown_connections 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.967+0000 7f508b1e5640 1 -- 172.21.15.66:0/231844893 wait complete. 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.967+0000 7f508b1e5640 1 Processor -- start 2024-09-21T07:06:16.970 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.967+0000 7f508b1e5640 1 -- start start 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f508b1e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50841037e0 0x7f5084199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f508b1e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5084104870 0x7f508419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f508b1e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084105210 0x7f508419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f508b1e5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f508410f3a0 con 0x7f50841037e0 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f508b1e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f508410f220 con 0x7f5084104870 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f508b1e5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f508410f520 con 0x7f5084105210 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084105210 0x7f508419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084105210 0x7f508419b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50332/0 (socket says 172.21.15.66:50332) 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 -- 172.21.15.66:0/588604030 learned_addr learned my addr 172.21.15.66:0/588604030 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5083fff640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5084104870 0x7f508419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:16.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5088f81640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50841037e0 0x7f5084199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 -- 172.21.15.66:0/588604030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5084104870 msgr2=0x7f508419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5084104870 0x7f508419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 -- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50841037e0 msgr2=0x7f5084199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50841037e0 0x7f5084199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 -- 172.21.15.66:0/588604030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508419b9d0 con 0x7f5084105210 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5088f81640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50841037e0 0x7f5084199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.968+0000 7f5089782640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084105210 0x7f508419b1b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f507c00eb10 tx=0x7f507c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.969+0000 7f5081ffb640 1 -- 172.21.15.66:0/588604030 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c004b20 con 0x7f5084105210 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.969+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508419bcc0 con 0x7f5084105210 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.969+0000 7f5081ffb640 1 -- 172.21.15.66:0/588604030 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f507c004cc0 con 0x7f5084105210 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.969+0000 7f5081ffb640 1 -- 172.21.15.66:0/588604030 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c010670 con 0x7f5084105210 2024-09-21T07:06:16.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.969+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50841a23c0 con 0x7f5084105210 2024-09-21T07:06:16.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.970+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5084103c50 con 0x7f5084105210 2024-09-21T07:06:16.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.972+0000 7f5081ffb640 1 -- 172.21.15.66:0/588604030 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f507c005000 con 0x7f5084105210 2024-09-21T07:06:16.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.973+0000 7f5081ffb640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50740b6510 0x7f50740b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:16.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.973+0000 7f5081ffb640 1 -- 172.21.15.66:0/588604030 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6398+0+0 (secure 0 0 0) 0x7f507c0e7370 con 0x7f5084105210 2024-09-21T07:06:16.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.973+0000 7f5088f81640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50740b6510 0x7f50740b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:16.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.974+0000 7f5088f81640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50740b6510 0x7f50740b8a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5078005d00 tx=0x7f5078005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:16.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:16.976+0000 7f5081ffb640 1 -- 172.21.15.66:0/588604030 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f507c056710 con 0x7f5084105210 2024-09-21T07:06:17.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:17.179+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5084063800 con 0x7f50740b6510 2024-09-21T07:06:17.182 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:17.182 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:06:17.182 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:06:17.182 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:06:17.182 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:17.182 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:06:17.182 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi052 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:17.183 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:17 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:17.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi052 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:17.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:17.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:17 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi052 2024-09-21T07:06:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:17.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:17.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:06:17.732+0000 7f7b5e3ad640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T07:06:17.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:06:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:06:17.745+0000 7f7b561a3640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:06:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:06:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:06:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:18.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:18.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:18.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:18.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:18 smithi066 ceph-mon[34793]: from='osd.10 ' entity='osd.10' 2024-09-21T07:06:18.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:06:18.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:06:18.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:18.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:18 smithi029 ceph-mon[30983]: from='osd.10 ' entity='osd.10' 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:18.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:18 smithi052 ceph-mon[34308]: from='osd.10 ' entity='osd.10' 2024-09-21T07:06:19.270 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:19 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:06:19.270 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:19 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:06:19.270 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:19 smithi066 ceph-mon[34793]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:19.270 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:19 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:19.270 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:19 smithi066 ceph-mon[34793]: osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] boot 2024-09-21T07:06:19.270 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:19 smithi066 ceph-mon[34793]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:06:19.270 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:19 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:19.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:19 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:06:19.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:19 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:06:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:19 smithi029 ceph-mon[30983]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:19 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:19 smithi029 ceph-mon[30983]: osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] boot 2024-09-21T07:06:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:19 smithi029 ceph-mon[30983]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:06:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:19 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:19 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:06:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:19 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:06:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:19 smithi052 ceph-mon[34308]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-21T07:06:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:19 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:19 smithi052 ceph-mon[34308]: osd.10 [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] boot 2024-09-21T07:06:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:19 smithi052 ceph-mon[34308]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T07:06:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:19 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T07:06:20.267 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:20 smithi066 ceph-mon[34793]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:06:20.267 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:20 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/1545122417' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"} : dispatch 2024-09-21T07:06:20.267 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:20 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"} : dispatch 2024-09-21T07:06:20.267 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:20 smithi066 ceph-mon[34793]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"}]': finished 2024-09-21T07:06:20.267 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:20 smithi066 ceph-mon[34793]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T07:06:20.268 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:20 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:20.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:20 smithi029 ceph-mon[30983]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:06:20.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:20 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/1545122417' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"} : dispatch 2024-09-21T07:06:20.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:20 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"} : dispatch 2024-09-21T07:06:20.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:20 smithi029 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"}]': finished 2024-09-21T07:06:20.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:20 smithi029 ceph-mon[30983]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T07:06:20.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:20 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:20 smithi052 ceph-mon[34308]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T07:06:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:20 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/1545122417' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"} : dispatch 2024-09-21T07:06:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:20 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"} : dispatch 2024-09-21T07:06:20.455 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:20 smithi052 ceph-mon[34308]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c6b8370-2b17-447f-b315-c7c04fb51288"}]': finished 2024-09-21T07:06:20.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:20 smithi052 ceph-mon[34308]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T07:06:20.456 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:20 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:21 smithi066 ceph-mon[34793]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:21 smithi066 ceph-mon[34793]: from='client.? 172.21.15.66:0/233290643' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:21.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:21 smithi029 ceph-mon[30983]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:21.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:21 smithi029 ceph-mon[30983]: from='client.? 172.21.15.66:0/233290643' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:21 smithi052 ceph-mon[34308]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:21 smithi052 ceph-mon[34308]: from='client.? 172.21.15.66:0/233290643' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T07:06:23.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:23 smithi066 ceph-mon[34793]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-21T07:06:23.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:23 smithi029 ceph-mon[30983]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-21T07:06:23.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:23 smithi052 ceph-mon[34308]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-21T07:06:25.245 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:25 smithi066 ceph-mon[34793]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:06:25.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:25 smithi029 ceph-mon[30983]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:06:25.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:25 smithi052 ceph-mon[34308]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T07:06:27.240 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:27 smithi066 ceph-mon[34793]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T07:06:27.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:27 smithi029 ceph-mon[30983]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T07:06:27.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:27 smithi052 ceph-mon[34308]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T07:06:28.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:06:28.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:28.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:06:28.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:28.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T07:06:28.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:29.349 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:29 smithi066 ceph-mon[34793]: Deploying daemon osd.11 on smithi066 2024-09-21T07:06:29.349 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:29 smithi066 ceph-mon[34793]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T07:06:29.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:29 smithi029 ceph-mon[30983]: Deploying daemon osd.11 on smithi066 2024-09-21T07:06:29.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:29 smithi029 ceph-mon[30983]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T07:06:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:29 smithi052 ceph-mon[34308]: Deploying daemon osd.11 on smithi066 2024-09-21T07:06:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:29 smithi052 ceph-mon[34308]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T07:06:31.208 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:31 smithi066 ceph-mon[34793]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:06:31.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:31 smithi029 ceph-mon[30983]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:06:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:31 smithi052 ceph-mon[34308]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T07:06:33.296 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:33 smithi066 ceph-mon[34793]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:06:33.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:33 smithi029 ceph-mon[30983]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:06:33.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:33 smithi052 ceph-mon[34308]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T07:06:34.253 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:34.253 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:34.253 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:34 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:34.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:34 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:34.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:34 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:34.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:34 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:34.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:34 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:34.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:34 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:34.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:34 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:35 smithi066 ceph-mon[34793]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:35 smithi029 ceph-mon[30983]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:35 smithi052 ceph-mon[34308]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:37.064 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.062+0000 7f5081ffb640 1 -- 172.21.15.66:0/588604030 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5084063800 con 0x7f50740b6510 2024-09-21T07:06:37.064 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 11 on host 'smithi066' 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50740b6510 msgr2=0x7f50740b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50740b6510 0x7f50740b8a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5078005d00 tx=0x7f5078005c70 comp rx=0 tx=0).stop 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084105210 msgr2=0x7f508419b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084105210 0x7f508419b1b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f507c00eb10 tx=0x7f507c00c2d0 comp rx=0 tx=0).stop 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 shutdown_connections 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f50740b6510 0x7f50740b8a20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5084105210 0x7f508419b1b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5084104870 0x7f508419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 --2- 172.21.15.66:0/588604030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f50841037e0 0x7f5084199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:37.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.064+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 >> 172.21.15.66:0/588604030 conn(0x7f50840ff150 msgr2=0x7f5084107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:37.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.065+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 shutdown_connections 2024-09-21T07:06:37.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:37.065+0000 7f508b1e5640 1 -- 172.21.15.66:0/588604030 wait complete. 2024-09-21T07:06:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:37.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:37 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:37.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:37 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.699 DEBUG:teuthology.orchestra.run.smithi066:osd.11> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T07:06:37.701 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T07:06:37.701 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:37 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:37.970 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 -- 172.21.15.29:0/817360114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0109470 msgr2=0x7f24e010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 --2- 172.21.15.29:0/817360114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0109470 0x7f24e010b980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009ca0 tx=0x7f24d802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 -- 172.21.15.29:0/817360114 shutdown_connections 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 --2- 172.21.15.29:0/817360114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e0109470 0x7f24e010b980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 --2- 172.21.15.29:0/817360114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e01068d0 0x7f24e0108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 --2- 172.21.15.29:0/817360114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e006b980 0x7f24e0106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 -- 172.21.15.29:0/817360114 >> 172.21.15.29:0/817360114 conn(0x7f24e00fdfb0 msgr2=0x7f24e0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 -- 172.21.15.29:0/817360114 shutdown_connections 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.468+0000 7f24e85a4640 1 -- 172.21.15.29:0/817360114 wait complete. 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 Processor -- start 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 -- start start 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e006b980 0x7f24e0199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e01068d0 0x7f24e019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0109470 0x7f24e019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f24e010f370 con 0x7f24e006b980 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24e010f1f0 con 0x7f24e01068d0 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.469+0000 7f24e85a4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24e010f4f0 con 0x7f24e0109470 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e006b980 0x7f24e0199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e5b3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e01068d0 0x7f24e019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e006b980 0x7f24e0199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42074/0 (socket says 172.21.15.29:42074) 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 -- 172.21.15.29:0/4244889148 learned_addr learned my addr 172.21.15.29:0/4244889148 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6b41640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0109470 0x7f24e019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 -- 172.21.15.29:0/4244889148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0109470 msgr2=0x7f24e019b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0109470 0x7f24e019b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 -- 172.21.15.29:0/4244889148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e01068d0 msgr2=0x7f24e019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e01068d0 0x7f24e019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 -- 172.21.15.29:0/4244889148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e019b960 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e5b3f640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e01068d0 0x7f24e019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24e6340640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e006b980 0x7f24e0199f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00d950 tx=0x7f24dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.470+0000 7f24d77fe640 1 -- 172.21.15.29:0/4244889148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc017070 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.471+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e019bc50 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.471+0000 7f24d77fe640 1 -- 172.21.15.29:0/4244889148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24dc009c30 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.471+0000 7f24d77fe640 1 -- 172.21.15.29:0/4244889148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00f620 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.471+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e0102340 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.472+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e0106d20 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.474+0000 7f24d77fe640 1 -- 172.21.15.29:0/4244889148 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f24dc010460 con 0x7f24e006b980 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.475+0000 7f24d77fe640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f24cc0b6510 0x7f24cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.475+0000 7f24d77fe640 1 -- 172.21.15.29:0/4244889148 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6809+0+0 (secure 0 0 0) 0x7f24dc0e6890 con 0x7f24e006b980 2024-09-21T07:06:38.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.475+0000 7f24e5b3f640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f24cc0b6510 0x7f24cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:38.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.476+0000 7f24e5b3f640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f24cc0b6510 0x7f24cc0b8a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24d000bfd0 tx=0x7f24d000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:38.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.479+0000 7f24d77fe640 1 -- 172.21.15.29:0/4244889148 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24dc009de0 con 0x7f24e006b980 2024-09-21T07:06:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.668+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f24e0063fc0 con 0x7f24e006b980 2024-09-21T07:06:38.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.668+0000 7f24d77fe640 1 -- 172.21.15.29:0/4244889148 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f24dc0b1ae0 con 0x7f24e006b980 2024-09-21T07:06:38.670 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f24cc0b6510 msgr2=0x7f24cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f24cc0b6510 0x7f24cc0b8a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f24d000bfd0 tx=0x7f24d000b390 comp rx=0 tx=0).stop 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e006b980 msgr2=0x7f24e0199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e006b980 0x7f24e0199f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00d950 tx=0x7f24dc00de10 comp rx=0 tx=0).stop 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 shutdown_connections 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f24cc0b6510 0x7f24cc0b8a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24e0109470 0x7f24e019b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24e01068d0 0x7f24e019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 --2- 172.21.15.29:0/4244889148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f24e006b980 0x7f24e0199f30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 >> 172.21.15.29:0/4244889148 conn(0x7f24e00fdfb0 msgr2=0x7f24e0104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 shutdown_connections 2024-09-21T07:06:38.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:38.671+0000 7f24e85a4640 1 -- 172.21.15.29:0/4244889148 wait complete. 2024-09-21T07:06:39.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:39 smithi029 ceph-mon[30983]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:39.503 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:39 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4244889148' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:39.531 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1726902378,"num_in_osds":12,"osd_in_since":1726902379,"num_remapped_pgs":0} 2024-09-21T07:06:39.546 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:39 smithi052 ceph-mon[34308]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:39.546 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:39 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4244889148' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:39.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:39 smithi066 ceph-mon[34793]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:39.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:39 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4244889148' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:39.884 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:06:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:06:39.625+0000 7f9db7642640 -1 osd.11 0 log_to_monitors true 2024-09-21T07:06:40.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:06:40.534 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:40 smithi066 ceph-mon[34793]: from='osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:06:40.534 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:40 smithi066 ceph-mon[34793]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:06:40.562 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:40 smithi029 ceph-mon[30983]: from='osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:06:40.563 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:40 smithi029 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:06:40.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:40 smithi052 ceph-mon[34308]: from='osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:06:40.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:40 smithi052 ceph-mon[34308]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T07:06:40.819 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.310+0000 7fec982c1640 1 -- 172.21.15.29:0/3994716107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec90103750 msgr2=0x7fec90103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.310+0000 7fec982c1640 1 --2- 172.21.15.29:0/3994716107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec90103750 0x7fec90103bc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009900 tx=0x7fec8c02a480 comp rx=0 tx=0).stop 2024-09-21T07:06:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.310+0000 7fec982c1640 1 -- 172.21.15.29:0/3994716107 shutdown_connections 2024-09-21T07:06:41.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.310+0000 7fec982c1640 1 --2- 172.21.15.29:0/3994716107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec90105180 0x7fec9010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.311+0000 7fec982c1640 1 --2- 172.21.15.29:0/3994716107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec901047e0 0x7fec90104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.311+0000 7fec982c1640 1 --2- 172.21.15.29:0/3994716107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec90103750 0x7fec90103bc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.311+0000 7fec982c1640 1 -- 172.21.15.29:0/3994716107 >> 172.21.15.29:0/3994716107 conn(0x7fec900ff0c0 msgr2=0x7fec90101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.311+0000 7fec982c1640 1 -- 172.21.15.29:0/3994716107 shutdown_connections 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.311+0000 7fec982c1640 1 -- 172.21.15.29:0/3994716107 wait complete. 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.311+0000 7fec982c1640 1 Processor -- start 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.311+0000 7fec982c1640 1 -- start start 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec982c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90103750 0x7fec9019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec982c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec901047e0 0x7fec9019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec982c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec90105180 0x7fec9019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec982c1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fec9010f390 con 0x7fec901047e0 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec982c1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec9010f210 con 0x7fec90103750 2024-09-21T07:06:41.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec982c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec9010f510 con 0x7fec90105180 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec901047e0 0x7fec9019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec901047e0 0x7fec9019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42090/0 (socket says 172.21.15.29:42090) 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 -- 172.21.15.29:0/3808227233 learned_addr learned my addr 172.21.15.29:0/3808227233 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9685e640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec90105180 0x7fec9019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9605d640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90103750 0x7fec9019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 -- 172.21.15.29:0/3808227233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec90105180 msgr2=0x7fec9019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec90105180 0x7fec9019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 -- 172.21.15.29:0/3808227233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90103750 msgr2=0x7fec9019a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90103750 0x7fec9019a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 -- 172.21.15.29:0/3808227233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9019b940 con 0x7fec901047e0 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9605d640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90103750 0x7fec9019a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec9585c640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec901047e0 0x7fec9019a680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c920 tx=0x7fec8000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec877fe640 1 -- 172.21.15.29:0/3808227233 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80007c70 con 0x7fec901047e0 2024-09-21T07:06:41.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.312+0000 7fec877fe640 1 -- 172.21.15.29:0/3808227233 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec80007e10 con 0x7fec901047e0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.313+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9019bc30 con 0x7fec901047e0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.313+0000 7fec877fe640 1 -- 172.21.15.29:0/3808227233 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80018820 con 0x7fec901047e0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.313+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a23c0 con 0x7fec901047e0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.314+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9010a930 con 0x7fec901047e0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.315+0000 7fec877fe640 1 -- 172.21.15.29:0/3808227233 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fec8000f450 con 0x7fec901047e0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.316+0000 7fec877fe640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec7c0b6510 0x7fec7c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.316+0000 7fec9605d640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec7c0b6510 0x7fec7c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.316+0000 7fec877fe640 1 -- 172.21.15.29:0/3808227233 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6847+0+0 (secure 0 0 0) 0x7fec800e70f0 con 0x7fec901047e0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.317+0000 7fec9605d640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec7c0b6510 0x7fec7c0b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec8c031440 tx=0x7fec8c005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:41.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.319+0000 7fec877fe640 1 -- 172.21.15.29:0/3808227233 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec80014030 con 0x7fec901047e0 2024-09-21T07:06:41.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.509+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fec90063fc0 con 0x7fec901047e0 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: Detected new or changed devices on smithi066 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.512 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-21T07:06:41.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:41.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:41.513 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.510+0000 7fec877fe640 1 -- 172.21.15.29:0/3808227233 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7fec800adfd0 con 0x7fec901047e0 2024-09-21T07:06:41.514 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:06:41.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec7c0b6510 msgr2=0x7fec7c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec7c0b6510 0x7fec7c0b8a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec8c031440 tx=0x7fec8c005d50 comp rx=0 tx=0).stop 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec901047e0 msgr2=0x7fec9019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec901047e0 0x7fec9019a680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c920 tx=0x7fec8000cde0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 shutdown_connections 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec7c0b6510 0x7fec7c0b8a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec90105180 0x7fec9019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec901047e0 0x7fec9019a680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 --2- 172.21.15.29:0/3808227233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90103750 0x7fec9019a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 >> 172.21.15.29:0/3808227233 conn(0x7fec900ff0c0 msgr2=0x7fec90107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 shutdown_connections 2024-09-21T07:06:41.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:41.512+0000 7fec982c1640 1 -- 172.21.15.29:0/3808227233 wait complete. 2024-09-21T07:06:41.602 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:06:41.265+0000 7f9db35c4640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T07:06:41.602 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:06:41.278+0000 7f9daf3c2640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:06:41.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:41.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:06:41.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:06:41.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: Detected new or changed devices on smithi066 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:41.603 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T07:06:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T07:06:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:06:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: Detected new or changed devices on smithi066 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi066 to 4272M 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:41.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:41.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:41.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:42.311 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726902378,"num_in_osds":12,"osd_in_since":1726902379,"num_remapped_pgs":0} 2024-09-21T07:06:42.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:42 smithi066 ceph-mon[34793]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:06:42.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:42 smithi066 ceph-mon[34793]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:06:42.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:42 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:42.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:42 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:42.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:42 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3808227233' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:42.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:42 smithi029 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:06:42.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:42 smithi029 ceph-mon[30983]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:06:42.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:42 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:42.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:42 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:42.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:42 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3808227233' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:42.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:42 smithi052 ceph-mon[34308]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-21T07:06:42.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:42 smithi052 ceph-mon[34308]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T07:06:42.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:42 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:42.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:42 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:42.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:42 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3808227233' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:43.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T07:06:43.582 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:43 smithi066 ceph-mon[34793]: purged_snaps scrub starts 2024-09-21T07:06:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:43 smithi066 ceph-mon[34793]: purged_snaps scrub ok 2024-09-21T07:06:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:43 smithi066 ceph-mon[34793]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:43 smithi066 ceph-mon[34793]: osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] boot 2024-09-21T07:06:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:43 smithi066 ceph-mon[34793]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T07:06:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:43 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:43 smithi029 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T07:06:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:43 smithi029 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T07:06:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:43 smithi029 ceph-mon[30983]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:43 smithi029 ceph-mon[30983]: osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] boot 2024-09-21T07:06:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:43 smithi029 ceph-mon[30983]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T07:06:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:43 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:43 smithi052 ceph-mon[34308]: purged_snaps scrub starts 2024-09-21T07:06:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:43 smithi052 ceph-mon[34308]: purged_snaps scrub ok 2024-09-21T07:06:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:43 smithi052 ceph-mon[34308]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail 2024-09-21T07:06:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:43 smithi052 ceph-mon[34308]: osd.11 [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] boot 2024-09-21T07:06:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:43 smithi052 ceph-mon[34308]: osdmap e67: 12 total, 12 up, 12 in 2024-09-21T07:06:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:43 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T07:06:44.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.033+0000 7f104d4be640 1 -- 172.21.15.29:0/1263516713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1048102640 msgr2=0x7f1048102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.033+0000 7f104d4be640 1 --2- 172.21.15.29:0/1263516713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1048102640 0x7f1048102ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1038009900 tx=0x7f103802a480 comp rx=0 tx=0).stop 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 -- 172.21.15.29:0/1263516713 shutdown_connections 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 --2- 172.21.15.29:0/1263516713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048104070 0x7f104810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 --2- 172.21.15.29:0/1263516713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10481036d0 0x7f1048103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 --2- 172.21.15.29:0/1263516713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1048102640 0x7f1048102ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 -- 172.21.15.29:0/1263516713 >> 172.21.15.29:0/1263516713 conn(0x7f10480fdfb0 msgr2=0x7f1048100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 -- 172.21.15.29:0/1263516713 shutdown_connections 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 -- 172.21.15.29:0/1263516713 wait complete. 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 Processor -- start 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.034+0000 7f104d4be640 1 -- start start 2024-09-21T07:06:44.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f104d4be640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048102640 0x7f1048106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f104d4be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10481036d0 0x7f1048104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f104d4be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1048104070 0x7f1048105040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f104d4be640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f104810e280 con 0x7f10481036d0 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f104d4be640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f104810e100 con 0x7f1048104070 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f104d4be640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f104810e400 con 0x7f1048102640 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10481036d0 0x7f1048104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10481036d0 0x7f1048104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42108/0 (socket says 172.21.15.29:42108) 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 -- 172.21.15.29:0/1055579258 learned_addr learned my addr 172.21.15.29:0/1055579258 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f1046ffd640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048102640 0x7f1048106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10477fe640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1048104070 0x7f1048105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 -- 172.21.15.29:0/1055579258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048102640 msgr2=0x7f1048106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048102640 0x7f1048106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 -- 172.21.15.29:0/1055579258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1048104070 msgr2=0x7f1048105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1048104070 0x7f1048105040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 -- 172.21.15.29:0/1055579258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1048105740 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10477fe640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1048104070 0x7f1048105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.035+0000 7f10467fc640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10481036d0 0x7f1048104b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f103c00c890 tx=0x7f103c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.036+0000 7f102ffff640 1 -- 172.21.15.29:0/1055579258 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c004220 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.036+0000 7f102ffff640 1 -- 172.21.15.29:0/1055579258 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f103c0043c0 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.036+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10481a4060 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.036+0000 7f102ffff640 1 -- 172.21.15.29:0/1055579258 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c004a00 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.036+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10481a4510 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.037+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10481a47d0 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.039+0000 7f102ffff640 1 -- 172.21.15.29:0/1055579258 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f103c0079b0 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.039+0000 7f102ffff640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f10300b6590 0x7f10300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.039+0000 7f102ffff640 1 -- 172.21.15.29:0/1055579258 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f103c0e6fe0 con 0x7f10481036d0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.039+0000 7f1046ffd640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f10300b6590 0x7f10300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:44.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.040+0000 7f1046ffd640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f10300b6590 0x7f10300b8aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1038031440 tx=0x7f10380314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:44.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.042+0000 7f102ffff640 1 -- 172.21.15.29:0/1055579258 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f103c014030 con 0x7f10481036d0 2024-09-21T07:06:44.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.235+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f10481a49a0 con 0x7f10481036d0 2024-09-21T07:06:44.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.236+0000 7f102ffff640 1 -- 172.21.15.29:0/1055579258 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f103c0add90 con 0x7f10481036d0 2024-09-21T07:06:44.237 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:06:44.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f10300b6590 msgr2=0x7f10300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:44.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f10300b6590 0x7f10300b8aa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1038031440 tx=0x7f10380314a0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10481036d0 msgr2=0x7f1048104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10481036d0 0x7f1048104b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f103c00c890 tx=0x7f103c00cd50 comp rx=0 tx=0).stop 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 shutdown_connections 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f10300b6590 0x7f10300b8aa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1048104070 0x7f1048105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10481036d0 0x7f1048104b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 --2- 172.21.15.29:0/1055579258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048102640 0x7f1048106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 >> 172.21.15.29:0/1055579258 conn(0x7f10480fdfb0 msgr2=0x7f10480ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 shutdown_connections 2024-09-21T07:06:44.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:44.238+0000 7f104d4be640 1 -- 172.21.15.29:0/1055579258 wait complete. 2024-09-21T07:06:44.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:44 smithi029 ceph-mon[30983]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:06:44.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:44 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1055579258' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:44.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:44 smithi066 ceph-mon[34793]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:06:44.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:44 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1055579258' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:44.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:44 smithi052 ceph-mon[34308]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T07:06:44.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:44 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1055579258' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T07:06:45.010 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726902402,"num_in_osds":12,"osd_in_since":1726902379,"num_remapped_pgs":0} 2024-09-21T07:06:45.010 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:06:45.267 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:45.532 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:45 smithi029 ceph-mon[30983]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:45.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:45 smithi066 ceph-mon[34793]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 -- 172.21.15.29:0/1529408813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc108cf0 msgr2=0x7f61cc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 --2- 172.21.15.29:0/1529408813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc108cf0 0x7f61cc10f520 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009ca0 tx=0x7f61c402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 -- 172.21.15.29:0/1529408813 shutdown_connections 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 --2- 172.21.15.29:0/1529408813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc108cf0 0x7f61cc10f520 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 --2- 172.21.15.29:0/1529408813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61cc1083a0 0x7f61cc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 --2- 172.21.15.29:0/1529408813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc102a60 0x7f61cc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 -- 172.21.15.29:0/1529408813 >> 172.21.15.29:0/1529408813 conn(0x7f61cc079730 msgr2=0x7f61cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 -- 172.21.15.29:0/1529408813 shutdown_connections 2024-09-21T07:06:45.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.711+0000 7f61d0e82640 1 -- 172.21.15.29:0/1529408813 wait complete. 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 Processor -- start 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 -- start start 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc102a60 0x7f61cc0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc1083a0 0x7f61cc0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61cc108cf0 0x7f61cc1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc112960 con 0x7f61cc102a60 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc1127e0 con 0x7f61cc108cf0 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61d0e82640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61cc112ae0 con 0x7f61cc1083a0 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61ca59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc102a60 0x7f61cc0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61ca59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc102a60 0x7f61cc0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42126/0 (socket says 172.21.15.29:42126) 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61ca59c640 1 -- 172.21.15.29:0/2102883629 learned_addr learned my addr 172.21.15.29:0/2102883629 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:06:45.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61cad9d640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61cc108cf0 0x7f61cc1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.712+0000 7f61c3fff640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc1083a0 0x7f61cc0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61ca59c640 1 -- 172.21.15.29:0/2102883629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc1083a0 msgr2=0x7f61cc0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61ca59c640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc1083a0 0x7f61cc0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61ca59c640 1 -- 172.21.15.29:0/2102883629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61cc108cf0 msgr2=0x7f61cc1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61ca59c640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61cc108cf0 0x7f61cc1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61ca59c640 1 -- 172.21.15.29:0/2102883629 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61cc1a8700 con 0x7f61cc102a60 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61ca59c640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc102a60 0x7f61cc0ff670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00d770 tx=0x7f61bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61c37fe640 1 -- 172.21.15.29:0/2102883629 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc017070 con 0x7f61cc102a60 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61c37fe640 1 -- 172.21.15.29:0/2102883629 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61bc0054d0 con 0x7f61cc102a60 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61cc1a89f0 con 0x7f61cc102a60 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61c37fe640 1 -- 172.21.15.29:0/2102883629 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc004c30 con 0x7f61cc102a60 2024-09-21T07:06:45.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.713+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61cc1a8ee0 con 0x7f61cc102a60 2024-09-21T07:06:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.714+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61cc102e70 con 0x7f61cc102a60 2024-09-21T07:06:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.716+0000 7f61c37fe640 1 -- 172.21.15.29:0/2102883629 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f61bc004dd0 con 0x7f61cc102a60 2024-09-21T07:06:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.717+0000 7f61c37fe640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f61b80b6510 0x7f61b80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.717+0000 7f61c3fff640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f61b80b6510 0x7f61b80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.717+0000 7f61c37fe640 1 -- 172.21.15.29:0/2102883629 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f61bc0e6cf0 con 0x7f61cc102a60 2024-09-21T07:06:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.718+0000 7f61c3fff640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f61b80b6510 0x7f61b80b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61b4005fd0 tx=0x7f61b4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:45.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.720+0000 7f61c37fe640 1 -- 172.21.15.29:0/2102883629 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61bc0ada20 con 0x7f61cc102a60 2024-09-21T07:06:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:45 smithi052 ceph-mon[34308]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:45.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.911+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61cc02e640 con 0x7f61cc102a60 2024-09-21T07:06:45.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.912+0000 7f61c37fe640 1 -- 172.21.15.29:0/2102883629 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18395 (secure 0 0 0) 0x7f61bc0b1e00 con 0x7f61cc102a60 2024-09-21T07:06:45.914 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:06:45.914 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":68,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:06:43.266894+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:06:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f61b80b6510 msgr2=0x7f61b80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f61b80b6510 0x7f61b80b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61b4005fd0 tx=0x7f61b4005850 comp rx=0 tx=0).stop 2024-09-21T07:06:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc102a60 msgr2=0x7f61cc0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc102a60 0x7f61cc0ff670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00d770 tx=0x7f61bc00dc30 comp rx=0 tx=0).stop 2024-09-21T07:06:45.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 shutdown_connections 2024-09-21T07:06:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f61b80b6510 0x7f61b80b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61cc108cf0 0x7f61cc1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc1083a0 0x7f61cc0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 --2- 172.21.15.29:0/2102883629 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61cc102a60 0x7f61cc0ff670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 >> 172.21.15.29:0/2102883629 conn(0x7f61cc079730 msgr2=0x7f61cc06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 shutdown_connections 2024-09-21T07:06:45.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:45.914+0000 7f61d0e82640 1 -- 172.21.15.29:0/2102883629 wait complete. 2024-09-21T07:06:46.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:46 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2102883629' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:06:46.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:46 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2102883629' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:06:46.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:46 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2102883629' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:06:46.769 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:02:52.375565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:06:46.769 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T07:06:47.031 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:47.423 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:47 smithi029 ceph-mon[30983]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1785944061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce810ddf0 msgr2=0x7f8ce8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1785944061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce810ddf0 0x7f8ce8110300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009ca0 tx=0x7f8ce002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1785944061 shutdown_connections 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1785944061 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce810ddf0 0x7f8ce8110300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1785944061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ce8105270 0x7f8ce810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1785944061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce8104840 0x7f8ce8104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1785944061 >> 172.21.15.29:0/1785944061 conn(0x7f8ce8079730 msgr2=0x7f8ce8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:47.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1785944061 shutdown_connections 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.517+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1785944061 wait complete. 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 Processor -- start 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 -- start start 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ce8104840 0x7f8ce8102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce8105270 0x7f8ce8102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce810ddf0 0x7f8ce81031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8113a90 con 0x7f8ce8105270 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8113910 con 0x7f8ce810ddf0 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cefd4d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce8113c10 con 0x7f8ce8104840 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8ced2e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce8105270 0x7f8ce8102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:47.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8ced2e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce8105270 0x7f8ce8102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38064/0 (socket says 172.21.15.29:38064) 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8ced2e8640 1 -- 172.21.15.29:0/1790492791 learned_addr learned my addr 172.21.15.29:0/1790492791 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.518+0000 7f8cedae9640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ce8104840 0x7f8ce8102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8cee2ea640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce810ddf0 0x7f8ce81031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8ced2e8640 1 -- 172.21.15.29:0/1790492791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ce8104840 msgr2=0x7f8ce8102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8ced2e8640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ce8104840 0x7f8ce8102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8ced2e8640 1 -- 172.21.15.29:0/1790492791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce810ddf0 msgr2=0x7f8ce81031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8ced2e8640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce810ddf0 0x7f8ce81031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8ced2e8640 1 -- 172.21.15.29:0/1790492791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce81a8780 con 0x7f8ce8105270 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8cee2ea640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce810ddf0 0x7f8ce81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8ced2e8640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce8105270 0x7f8ce8102c90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800d750 tx=0x7f8cd800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8cdeffd640 1 -- 172.21.15.29:0/1790492791 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8017070 con 0x7f8ce8105270 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce81a8a70 con 0x7f8ce8105270 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8cdeffd640 1 -- 172.21.15.29:0/1790492791 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd80054d0 con 0x7f8ce8105270 2024-09-21T07:06:47.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8cdeffd640 1 -- 172.21.15.29:0/1790492791 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8004c30 con 0x7f8ce8105270 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.519+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce81a8f60 con 0x7f8ce8105270 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.520+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce8104c50 con 0x7f8ce8105270 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.522+0000 7f8cdeffd640 1 -- 172.21.15.29:0/1790492791 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8cd8004dd0 con 0x7f8ce8105270 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.523+0000 7f8cdeffd640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8cd40b6510 0x7f8cd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.523+0000 7f8cedae9640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8cd40b6510 0x7f8cd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.523+0000 7f8cdeffd640 1 -- 172.21.15.29:0/1790492791 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f8cd80e6c50 con 0x7f8ce8105270 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.523+0000 7f8cedae9640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8cd40b6510 0x7f8cd40b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ce81041a0 tx=0x7f8ce400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:47.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.526+0000 7f8cdeffd640 1 -- 172.21.15.29:0/1790492791 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8cd80ad980 con 0x7f8ce8105270 2024-09-21T07:06:47.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:47 smithi066 ceph-mon[34793]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:47.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.714+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8ce81a9330 con 0x7f8ce8105270 2024-09-21T07:06:47.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.715+0000 7f8cdeffd640 1 -- 172.21.15.29:0/1790492791 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7f8cd80b1d60 con 0x7f8ce8105270 2024-09-21T07:06:47.716 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8cd40b6510 msgr2=0x7f8cd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8cd40b6510 0x7f8cd40b8a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ce81041a0 tx=0x7f8ce400b390 comp rx=0 tx=0).stop 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce8105270 msgr2=0x7f8ce8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce8105270 0x7f8ce8102c90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800d750 tx=0x7f8cd800dc10 comp rx=0 tx=0).stop 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 shutdown_connections 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8cd40b6510 0x7f8cd40b8a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce810ddf0 0x7f8ce81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce8105270 0x7f8ce8102c90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 --2- 172.21.15.29:0/1790492791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ce8104840 0x7f8ce8102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:47.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 >> 172.21.15.29:0/1790492791 conn(0x7f8ce8079730 msgr2=0x7f8ce8107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:47.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 shutdown_connections 2024-09-21T07:06:47.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:47.717+0000 7f8cefd4d640 1 -- 172.21.15.29:0/1790492791 wait complete. 2024-09-21T07:06:47.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:47 smithi052 ceph-mon[34308]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:48.433 INFO:tasks.cephadm:Adding mds.a on smithi029 2024-09-21T07:06:48.433 INFO:tasks.cephadm:Adding mds.d on smithi029 2024-09-21T07:06:48.433 INFO:tasks.cephadm:Adding mds.g on smithi029 2024-09-21T07:06:48.433 INFO:tasks.cephadm:Adding mds.j on smithi029 2024-09-21T07:06:48.433 INFO:tasks.cephadm:Adding mds.b on smithi052 2024-09-21T07:06:48.433 INFO:tasks.cephadm:Adding mds.e on smithi052 2024-09-21T07:06:48.434 INFO:tasks.cephadm:Adding mds.h on smithi052 2024-09-21T07:06:48.434 INFO:tasks.cephadm:Adding mds.k on smithi052 2024-09-21T07:06:48.434 INFO:tasks.cephadm:Adding mds.c on smithi066 2024-09-21T07:06:48.434 INFO:tasks.cephadm:Adding mds.f on smithi066 2024-09-21T07:06:48.434 INFO:tasks.cephadm:Adding mds.i on smithi066 2024-09-21T07:06:48.434 INFO:tasks.cephadm:Adding mds.l on smithi066 2024-09-21T07:06:48.434 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l' 2024-09-21T07:06:48.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:48 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1790492791' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:06:48.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:48 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1790492791' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:06:48.705 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:06:48.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:48 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1790492791' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:06:49.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 -- 172.21.15.66:0/1246384487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08781036e0 msgr2=0x7f0878103af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 --2- 172.21.15.66:0/1246384487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08781036e0 0x7f0878103af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f086c009ca0 tx=0x7f086c02a950 comp rx=0 tx=0).stop 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 -- 172.21.15.66:0/1246384487 shutdown_connections 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 --2- 172.21.15.66:0/1246384487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0878104080 0x7f087810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 --2- 172.21.15.66:0/1246384487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08781036e0 0x7f0878103af0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 --2- 172.21.15.66:0/1246384487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0878102650 0x7f0878102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 -- 172.21.15.66:0/1246384487 >> 172.21.15.66:0/1246384487 conn(0x7f08780fdfe0 msgr2=0x7f0878100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 -- 172.21.15.66:0/1246384487 shutdown_connections 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.165+0000 7f087f26b640 1 -- 172.21.15.66:0/1246384487 wait complete. 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 Processor -- start 2024-09-21T07:06:49.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 -- start start 2024-09-21T07:06:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0878102650 0x7f0878198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08781036e0 0x7f0878199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878104080 0x7f087819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f087810e280 con 0x7f0878102650 2024-09-21T07:06:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f087810e100 con 0x7f08781036e0 2024-09-21T07:06:49.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087f26b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f087810e400 con 0x7f0878104080 2024-09-21T07:06:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087d808640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878104080 0x7f087819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087d808640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878104080 0x7f087819a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45590/0 (socket says 172.21.15.66:45590) 2024-09-21T07:06:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087d808640 1 -- 172.21.15.66:0/1217339041 learned_addr learned my addr 172.21.15.66:0/1217339041 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-21T07:06:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.166+0000 7f087d007640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0878102650 0x7f0878198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087c806640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08781036e0 0x7f0878199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:49.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087d808640 1 -- 172.21.15.66:0/1217339041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08781036e0 msgr2=0x7f0878199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087d808640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08781036e0 0x7f0878199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087d808640 1 -- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0878102650 msgr2=0x7f0878198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087d808640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0878102650 0x7f0878198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087d808640 1 -- 172.21.15.66:0/1217339041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087819a910 con 0x7f0878104080 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087d808640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878104080 0x7f087819a0f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f087000d750 tx=0x7f087000dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f086a7fc640 1 -- 172.21.15.66:0/1217339041 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870017070 con 0x7f0878104080 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f086a7fc640 1 -- 172.21.15.66:0/1217339041 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08700054d0 con 0x7f0878104080 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087819ac00 con 0x7f0878104080 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f086a7fc640 1 -- 172.21.15.66:0/1217339041 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870004c60 con 0x7f0878104080 2024-09-21T07:06:49.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.167+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08781a1300 con 0x7f0878104080 2024-09-21T07:06:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.168+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0878102ac0 con 0x7f0878104080 2024-09-21T07:06:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.171+0000 7f086a7fc640 1 -- 172.21.15.66:0/1217339041 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0870009bd0 con 0x7f0878104080 2024-09-21T07:06:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.171+0000 7f086a7fc640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08640b6510 0x7f08640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.171+0000 7f086a7fc640 1 -- 172.21.15.66:0/1217339041 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f08700e6c00 con 0x7f0878104080 2024-09-21T07:06:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.172+0000 7f087d007640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08640b6510 0x7f08640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.172+0000 7f087d007640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08640b6510 0x7f08640b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f087400bbe0 tx=0x7f087400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:49.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.175+0000 7f086a7fc640 1 -- 172.21.15.66:0/1217339041 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08700ad930 con 0x7f0878104080 2024-09-21T07:06:49.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.372+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l", "target": ["mon-mgr", ""]}) -- 0x7f0878063900 con 0x7f08640b6510 2024-09-21T07:06:49.375 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:49 smithi066 ceph-mon[34793]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:49.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.380+0000 7f086a7fc640 1 -- 172.21.15.66:0/1217339041 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0878063900 con 0x7f08640b6510 2024-09-21T07:06:49.383 INFO:teuthology.orchestra.run.smithi066.stdout:Scheduled mds.all update... 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.382+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08640b6510 msgr2=0x7f08640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.382+0000 7f087f26b640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08640b6510 0x7f08640b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f087400bbe0 tx=0x7f087400b390 comp rx=0 tx=0).stop 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.382+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878104080 msgr2=0x7f087819a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.382+0000 7f087f26b640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878104080 0x7f087819a0f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f087000d750 tx=0x7f087000dc10 comp rx=0 tx=0).stop 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 shutdown_connections 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08640b6510 0x7f08640b8a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878104080 0x7f087819a0f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08781036e0 0x7f0878199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 --2- 172.21.15.66:0/1217339041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0878102650 0x7f0878198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:49.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 >> 172.21.15.66:0/1217339041 conn(0x7f08780fdfe0 msgr2=0x7f08781069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:49.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 shutdown_connections 2024-09-21T07:06:49.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-21T07:06:49.383+0000 7f087f26b640 1 -- 172.21.15.66:0/1217339041 wait complete. 2024-09-21T07:06:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:49 smithi029 ceph-mon[30983]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:49.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:49 smithi052 ceph-mon[34308]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:50.035 DEBUG:teuthology.orchestra.run.smithi029:mds.a> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T07:06:50.038 DEBUG:teuthology.orchestra.run.smithi029:mds.d> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T07:06:50.082 DEBUG:teuthology.orchestra.run.smithi029:mds.g> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T07:06:50.125 DEBUG:teuthology.orchestra.run.smithi029:mds.j> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T07:06:50.168 DEBUG:teuthology.orchestra.run.smithi052:mds.b> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T07:06:50.170 DEBUG:teuthology.orchestra.run.smithi052:mds.e> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T07:06:50.213 DEBUG:teuthology.orchestra.run.smithi052:mds.h> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T07:06:50.255 DEBUG:teuthology.orchestra.run.smithi052:mds.k> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T07:06:50.298 DEBUG:teuthology.orchestra.run.smithi066:mds.c> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T07:06:50.300 DEBUG:teuthology.orchestra.run.smithi066:mds.f> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T07:06:50.343 DEBUG:teuthology.orchestra.run.smithi066:mds.i> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T07:06:50.386 DEBUG:teuthology.orchestra.run.smithi066:mds.l> sudo journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T07:06:50.429 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T07:06:50.429 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:06:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: Saving service mds.all spec with placement smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l;count:12 2024-09-21T07:06:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:50.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:50.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:50.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:50.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:50 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:50.518 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:50.518 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: Saving service mds.all spec with placement smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l;count:12 2024-09-21T07:06:50.518 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:50.519 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:50.519 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:50.519 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:50.519 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:50.519 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:50.519 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:50.519 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:50 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:50.690 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:50.811 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:06:50.811 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: Saving service mds.all spec with placement smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l;count:12 2024-09-21T07:06:50.811 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:50.811 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:06:50.811 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:50.811 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:06:50.812 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:50.812 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:50.812 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:50.812 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:50 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:51.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 -- 172.21.15.29:0/3961397509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c1083c0 msgr2=0x7f0d9c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/3961397509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c1083c0 0x7f0d9c1087d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009900 tx=0x7f0d8c02a410 comp rx=0 tx=0).stop 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 -- 172.21.15.29:0/3961397509 shutdown_connections 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/3961397509 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c108d10 0x7f0d9c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/3961397509 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c1083c0 0x7f0d9c1087d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/3961397509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d9c102a80 0x7f0d9c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 -- 172.21.15.29:0/3961397509 >> 172.21.15.29:0/3961397509 conn(0x7f0d9c079740 msgr2=0x7f0d9c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 -- 172.21.15.29:0/3961397509 shutdown_connections 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.173+0000 7f0da3fdf640 1 -- 172.21.15.29:0/3961397509 wait complete. 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 Processor -- start 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 -- start start 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c102a80 0x7f0d9c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:51.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d9c1083c0 0x7f0d9c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c108d10 0x7f0d9c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c112980 con 0x7f0d9c108d10 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c112800 con 0x7f0d9c102a80 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da3fdf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c112b00 con 0x7f0d9c1083c0 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c108d10 0x7f0d9c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c108d10 0x7f0d9c19fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38076/0 (socket says 172.21.15.29:38076) 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 -- 172.21.15.29:0/1758549661 learned_addr learned my addr 172.21.15.29:0/1758549661 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da1d7b640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c102a80 0x7f0d9c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da157a640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d9c1083c0 0x7f0d9c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 -- 172.21.15.29:0/1758549661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d9c1083c0 msgr2=0x7f0d9c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d9c1083c0 0x7f0d9c19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 -- 172.21.15.29:0/1758549661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c102a80 msgr2=0x7f0d9c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c102a80 0x7f0d9c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da257c640 1 -- 172.21.15.29:0/1758549661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c1a03d0 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.174+0000 7f0da1d7b640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c102a80 0x7f0d9c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.175+0000 7f0da257c640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c108d10 0x7f0d9c19fca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400eaa0 tx=0x7f0d9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.175+0000 7f0d92ffd640 1 -- 172.21.15.29:0/1758549661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400cdb0 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.175+0000 7f0d92ffd640 1 -- 172.21.15.29:0/1758549661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d94005020 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.175+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c1a06c0 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.175+0000 7f0d92ffd640 1 -- 172.21.15.29:0/1758549661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940116d0 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.175+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1a6e20 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.176+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c103d00 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.177+0000 7f0d92ffd640 1 -- 172.21.15.29:0/1758549661 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0d940051d0 con 0x7f0d9c108d10 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.178+0000 7f0d92ffd640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0d880b6510 0x7f0d880b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:51.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.178+0000 7f0da1d7b640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0d880b6510 0x7f0d880b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:51.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.178+0000 7f0d92ffd640 1 -- 172.21.15.29:0/1758549661 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f0d940e7190 con 0x7f0d9c108d10 2024-09-21T07:06:51.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.179+0000 7f0da1d7b640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0d880b6510 0x7f0d880b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009c20 tx=0x7f0d98005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:51.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.182+0000 7f0d92ffd640 1 -- 172.21.15.29:0/1758549661 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d94016030 con 0x7f0d9c108d10 2024-09-21T07:06:51.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.406+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d9c1a7080 con 0x7f0d9c108d10 2024-09-21T07:06:51.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.406+0000 7f0d92ffd640 1 -- 172.21.15.29:0/1758549661 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f0d940a7e20 con 0x7f0d9c108d10 2024-09-21T07:06:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:06:51.409 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":1,"btime":"2024-09-21T06:59:06:543660+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T07:06:51.409 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 1 2024-09-21T07:06:51.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0d880b6510 msgr2=0x7f0d880b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:51.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0d880b6510 0x7f0d880b8a20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009c20 tx=0x7f0d98005f90 comp rx=0 tx=0).stop 2024-09-21T07:06:51.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c108d10 msgr2=0x7f0d9c19fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:51.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c108d10 0x7f0d9c19fca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400eaa0 tx=0x7f0d9400ef60 comp rx=0 tx=0).stop 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 shutdown_connections 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0d880b6510 0x7f0d880b8a20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d9c108d10 0x7f0d9c19fca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d9c1083c0 0x7f0d9c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 --2- 172.21.15.29:0/1758549661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c102a80 0x7f0d9c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.408+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 >> 172.21.15.29:0/1758549661 conn(0x7f0d9c079740 msgr2=0x7f0d9c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.409+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 shutdown_connections 2024-09-21T07:06:51.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:51.409+0000 7f0da3fdf640 1 -- 172.21.15.29:0/1758549661 wait complete. 2024-09-21T07:06:51.508 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:51 smithi066 ceph-mon[34793]: Deploying daemon mds.l on smithi066 2024-09-21T07:06:51.508 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:51 smithi066 ceph-mon[34793]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:51 smithi052 ceph-mon[34308]: Deploying daemon mds.l on smithi066 2024-09-21T07:06:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:51 smithi052 ceph-mon[34308]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:51.851 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:51 smithi066 systemd[1]: Starting Ceph mds.l for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:06:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:51 smithi029 ceph-mon[30983]: Deploying daemon mds.l on smithi066 2024-09-21T07:06:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:51 smithi029 ceph-mon[30983]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:52.171 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:51 smithi066 podman[63668]: 2024-09-21 07:06:51.810519481 +0000 UTC m=+0.016352924 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:06:52.171 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:51 smithi066 podman[63668]: 2024-09-21 07:06:51.923346069 +0000 UTC m=+0.129179511 container create 979f5ce93d60ee0a5e035731f68eaea413ecc439171f43f93a8ad6c6e130be74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:06:52.171 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:52 smithi066 podman[63668]: 2024-09-21 07:06:52.134138231 +0000 UTC m=+0.339971676 container init 979f5ce93d60ee0a5e035731f68eaea413ecc439171f43f93a8ad6c6e130be74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T07:06:52.172 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:52 smithi066 podman[63668]: 2024-09-21 07:06:52.13704906 +0000 UTC m=+0.342882502 container start 979f5ce93d60ee0a5e035731f68eaea413ecc439171f43f93a8ad6c6e130be74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T07:06:52.172 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mds[63687]: -- 172.21.15.66:0/2701580881 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556de57af860 con 0x556de9957600 2024-09-21T07:06:52.601 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l[63683]: starting mds.l at 2024-09-21T07:06:52.601 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:52 smithi066 bash[63668]: 979f5ce93d60ee0a5e035731f68eaea413ecc439171f43f93a8ad6c6e130be74 2024-09-21T07:06:52.601 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:06:52 smithi066 systemd[1]: Started Ceph mds.l for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:06:52.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1758549661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:52.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6832/3104127935,v1:172.21.15.66:6833/3104127935] up:boot 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: fsmap 1 up:standby 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:52.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1758549661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6832/3104127935,v1:172.21.15.66:6833/3104127935] up:boot 2024-09-21T07:06:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: fsmap 1 up:standby 2024-09-21T07:06:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:06:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:52.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:52.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:52.692 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1758549661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6832/3104127935,v1:172.21.15.66:6833/3104127935] up:boot 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: fsmap 1 up:standby 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:52.693 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:53.641 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:53 smithi052 ceph-mon[34308]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:53.641 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:53 smithi052 ceph-mon[34308]: Deploying daemon mds.k on smithi052 2024-09-21T07:06:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:53 smithi066 ceph-mon[34793]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:53 smithi066 ceph-mon[34793]: Deploying daemon mds.k on smithi052 2024-09-21T07:06:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:53 smithi029 ceph-mon[30983]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:53 smithi029 ceph-mon[30983]: Deploying daemon mds.k on smithi052 2024-09-21T07:06:54.243 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 systemd[1]: Starting Ceph mds.k for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:06:54.346 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:06:54.560 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 podman[61404]: 2024-09-21 07:06:54.206653079 +0000 UTC m=+0.015977668 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:06:54.560 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 podman[61404]: 2024-09-21 07:06:54.323503485 +0000 UTC m=+0.132828062 container create 2116dc47abe42c5948f2381f9fe3a6dc5c1359aafda1de17d433be7c2bb71e78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:06:54.560 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 podman[61404]: 2024-09-21 07:06:54.559518288 +0000 UTC m=+0.368842868 container init 2116dc47abe42c5948f2381f9fe3a6dc5c1359aafda1de17d433be7c2bb71e78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T07:06:54.615 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:06:54.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 podman[61404]: 2024-09-21 07:06:54.562398348 +0000 UTC m=+0.371722936 container start 2116dc47abe42c5948f2381f9fe3a6dc5c1359aafda1de17d433be7c2bb71e78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T07:06:54.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 ceph-mds[61423]: -- 172.21.15.52:0/1798147978 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d4f9c1860 con 0x560d53b69600 2024-09-21T07:06:54.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k[61419]: starting mds.k at 2024-09-21T07:06:54.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 bash[61404]: 2116dc47abe42c5948f2381f9fe3a6dc5c1359aafda1de17d433be7c2bb71e78 2024-09-21T07:06:54.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:06:54 smithi052 systemd[1]: Started Ceph mds.k for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:06:55.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 -- 172.21.15.29:0/1621233889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff68109df0 msgr2=0x7eff68110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:55.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 --2- 172.21.15.29:0/1621233889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff68109df0 0x7eff68110620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff60009ca0 tx=0x7eff6002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 -- 172.21.15.29:0/1621233889 shutdown_connections 2024-09-21T07:06:55.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 --2- 172.21.15.29:0/1621233889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff68109df0 0x7eff68110620 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 --2- 172.21.15.29:0/1621233889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff681094a0 0x7eff681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 --2- 172.21.15.29:0/1621233889 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff68103b60 0x7eff68103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 -- 172.21.15.29:0/1621233889 >> 172.21.15.29:0/1621233889 conn(0x7eff6807b850 msgr2=0x7eff6807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 -- 172.21.15.29:0/1621233889 shutdown_connections 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.126+0000 7eff6cc93640 1 -- 172.21.15.29:0/1621233889 wait complete. 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 Processor -- start 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 -- start start 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff68103b60 0x7eff6819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff681094a0 0x7eff6819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff68109df0 0x7eff6819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7eff68113ab0 con 0x7eff681094a0 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7eff68113930 con 0x7eff68103b60 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff6cc93640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7eff68113c30 con 0x7eff68109df0 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.127+0000 7eff65d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff681094a0 0x7eff6819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff681094a0 0x7eff6819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38092/0 (socket says 172.21.15.29:38092) 2024-09-21T07:06:55.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 -- 172.21.15.29:0/377920463 learned_addr learned my addr 172.21.15.29:0/377920463 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff6659c640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff68103b60 0x7eff6819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff66d9d640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff68109df0 0x7eff6819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 -- 172.21.15.29:0/377920463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff68109df0 msgr2=0x7eff6819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff68109df0 0x7eff6819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 -- 172.21.15.29:0/377920463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff68103b60 msgr2=0x7eff6819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff68103b60 0x7eff6819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 -- 172.21.15.29:0/377920463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff681a02f0 con 0x7eff681094a0 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff66d9d640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff68109df0 0x7eff6819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff65d9b640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff681094a0 0x7eff6819a9e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7eff5000d740 tx=0x7eff5000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff5f7fe640 1 -- 172.21.15.29:0/377920463 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50017070 con 0x7eff681094a0 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff681a05e0 con 0x7eff681094a0 2024-09-21T07:06:55.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff5f7fe640 1 -- 172.21.15.29:0/377920463 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff50010460 con 0x7eff681094a0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff5f7fe640 1 -- 172.21.15.29:0/377920463 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5000f600 con 0x7eff681094a0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.128+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff681a6e00 con 0x7eff681094a0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.129+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff68103f70 con 0x7eff681094a0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.131+0000 7eff5f7fe640 1 -- 172.21.15.29:0/377920463 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7eff5001a070 con 0x7eff681094a0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.132+0000 7eff5f7fe640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7eff540b6540 0x7eff540b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.132+0000 7eff6659c640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7eff540b6540 0x7eff540b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.132+0000 7eff5f7fe640 1 -- 172.21.15.29:0/377920463 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7eff500e6860 con 0x7eff681094a0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.133+0000 7eff6659c640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7eff540b6540 0x7eff540b8a50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7eff5800abe0 tx=0x7eff5800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:06:55.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.135+0000 7eff5f7fe640 1 -- 172.21.15.29:0/377920463 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff500ad4f0 con 0x7eff681094a0 2024-09-21T07:06:55.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.379+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff6810bbe0 con 0x7eff681094a0 2024-09-21T07:06:55.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.379+0000 7eff5f7fe640 1 -- 172.21.15.29:0/377920463 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7eff500b18d0 con 0x7eff681094a0 2024-09-21T07:06:55.382 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:06:55.382 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"btime":"2024-09-21T07:06:52:175998+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:06:55.383 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7eff540b6540 msgr2=0x7eff540b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7eff540b6540 0x7eff540b8a50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7eff5800abe0 tx=0x7eff5800a2d0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff681094a0 msgr2=0x7eff6819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff681094a0 0x7eff6819a9e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7eff5000d740 tx=0x7eff5000db40 comp rx=0 tx=0).stop 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 shutdown_connections 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7eff540b6540 0x7eff540b8a50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff68109df0 0x7eff6819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff681094a0 0x7eff6819a9e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 --2- 172.21.15.29:0/377920463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff68103b60 0x7eff6819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 >> 172.21.15.29:0/377920463 conn(0x7eff6807b850 msgr2=0x7eff681074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:06:55.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 shutdown_connections 2024-09-21T07:06:55.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:06:55.382+0000 7eff6cc93640 1 -- 172.21.15.29:0/377920463 wait complete. 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: Deploying daemon mds.j on smithi029 2024-09-21T07:06:55.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/377920463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:55.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6832/2941334623,v1:172.21.15.52:6833/2941334623] up:boot 2024-09-21T07:06:55.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: fsmap 2 up:standby 2024-09-21T07:06:55.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:06:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: Deploying daemon mds.j on smithi029 2024-09-21T07:06:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/377920463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6832/2941334623,v1:172.21.15.52:6833/2941334623] up:boot 2024-09-21T07:06:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: fsmap 2 up:standby 2024-09-21T07:06:56.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:06:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: Deploying daemon mds.j on smithi029 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/377920463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6832/2941334623,v1:172.21.15.52:6833/2941334623] up:boot 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: fsmap 2 up:standby 2024-09-21T07:06:56.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:06:57.359 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 systemd[1]: Starting Ceph mds.j for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:06:57.610 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 podman[68776]: 2024-09-21 07:06:57.473597863 +0000 UTC m=+0.016493532 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:06:57.611 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 podman[68776]: 2024-09-21 07:06:57.60983676 +0000 UTC m=+0.152732489 container create faabcc6a09e405d01e813b40ca792f8b20585a9040b053a46c038c100874bcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:06:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:57 smithi029 ceph-mon[30983]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:57.871 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 podman[68776]: 2024-09-21 07:06:57.840740655 +0000 UTC m=+0.383636325 container init faabcc6a09e405d01e813b40ca792f8b20585a9040b053a46c038c100874bcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:06:57.871 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 podman[68776]: 2024-09-21 07:06:57.843704289 +0000 UTC m=+0.386599958 container start faabcc6a09e405d01e813b40ca792f8b20585a9040b053a46c038c100874bcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:06:57.951 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:57 smithi052 ceph-mon[34308]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:57 smithi066 ceph-mon[34793]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:58.371 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 ceph-mds[68795]: -- 172.21.15.29:0/3994048474 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c798bed860 con 0x55c79cd95180 2024-09-21T07:06:58.371 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j[68791]: starting mds.j at 2024-09-21T07:06:58.371 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 bash[68776]: faabcc6a09e405d01e813b40ca792f8b20585a9040b053a46c038c100874bcba 2024-09-21T07:06:58.371 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:06:57 smithi029 systemd[1]: Started Ceph mds.j for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:06:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:59.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: Deploying daemon mds.d on smithi029 2024-09-21T07:06:59.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.29:6834/3753140533,v1:172.21.15.29:6835/3753140533] up:boot 2024-09-21T07:06:59.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: fsmap 3 up:standby 2024-09-21T07:06:59.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:06:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:06:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: Deploying daemon mds.d on smithi029 2024-09-21T07:06:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.29:6834/3753140533,v1:172.21.15.29:6835/3753140533] up:boot 2024-09-21T07:06:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: fsmap 3 up:standby 2024-09-21T07:06:59.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:06:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:06:59.388 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: Deploying daemon mds.d on smithi029 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.29:6834/3753140533,v1:172.21.15.29:6835/3753140533] up:boot 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: fsmap 3 up:standby 2024-09-21T07:06:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:06:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T07:06:59.667 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:00.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 -- 172.21.15.29:0/222969165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d20103b60 msgr2=0x7f2d20103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:00.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 --2- 172.21.15.29:0/222969165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d20103b60 0x7f2d20103f70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009900 tx=0x7f2d1002a410 comp rx=0 tx=0).stop 2024-09-21T07:07:00.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 -- 172.21.15.29:0/222969165 shutdown_connections 2024-09-21T07:07:00.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 --2- 172.21.15.29:0/222969165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d20109df0 0x7f2d20110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 --2- 172.21.15.29:0/222969165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d201094a0 0x7f2d201098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 --2- 172.21.15.29:0/222969165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d20103b60 0x7f2d20103f70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 -- 172.21.15.29:0/222969165 >> 172.21.15.29:0/222969165 conn(0x7f2d2007b850 msgr2=0x7f2d2007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 -- 172.21.15.29:0/222969165 shutdown_connections 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.351+0000 7f2d26015640 1 -- 172.21.15.29:0/222969165 wait complete. 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.352+0000 7f2d26015640 1 Processor -- start 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.352+0000 7f2d26015640 1 -- start start 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d26015640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d20103b60 0x7f2d2019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d26015640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d201094a0 0x7f2d2019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d26015640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d20109df0 0x7f2d2019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d26015640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2d20113ab0 con 0x7f2d201094a0 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d26015640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d20113930 con 0x7f2d20103b60 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d26015640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2d20113c30 con 0x7f2d20109df0 2024-09-21T07:07:00.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d201094a0 0x7f2d2019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d201094a0 0x7f2d2019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53606/0 (socket says 172.21.15.29:53606) 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 -- 172.21.15.29:0/2011147091 learned_addr learned my addr 172.21.15.29:0/2011147091 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1f7fe640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d20103b60 0x7f2d2019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1ffff640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d20109df0 0x7f2d2019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 -- 172.21.15.29:0/2011147091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d20109df0 msgr2=0x7f2d2019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d20109df0 0x7f2d2019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 -- 172.21.15.29:0/2011147091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d20103b60 msgr2=0x7f2d2019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d20103b60 0x7f2d2019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 -- 172.21.15.29:0/2011147091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d201a0310 con 0x7f2d201094a0 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1ffff640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d20109df0 0x7f2d2019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1effd640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d201094a0 0x7f2d2019aa00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c8c0 tx=0x7f2d1400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.353+0000 7f2d1cff9640 1 -- 172.21.15.29:0/2011147091 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14007bb0 con 0x7f2d201094a0 2024-09-21T07:07:00.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.354+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d201a0600 con 0x7f2d201094a0 2024-09-21T07:07:00.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.354+0000 7f2d1cff9640 1 -- 172.21.15.29:0/2011147091 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d14007d50 con 0x7f2d201094a0 2024-09-21T07:07:00.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.354+0000 7f2d1cff9640 1 -- 172.21.15.29:0/2011147091 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140187c0 con 0x7f2d201094a0 2024-09-21T07:07:00.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.354+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d200755f0 con 0x7f2d201094a0 2024-09-21T07:07:00.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.355+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d20104de0 con 0x7f2d201094a0 2024-09-21T07:07:00.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.356+0000 7f2d1cff9640 1 -- 172.21.15.29:0/2011147091 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2d1400fa20 con 0x7f2d201094a0 2024-09-21T07:07:00.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.357+0000 7f2d1cff9640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d080b6540 0x7f2d080b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:00.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.357+0000 7f2d1f7fe640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d080b6540 0x7f2d080b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:00.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.357+0000 7f2d1cff9640 1 -- 172.21.15.29:0/2011147091 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f2d140e6fa0 con 0x7f2d201094a0 2024-09-21T07:07:00.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.358+0000 7f2d1f7fe640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d080b6540 0x7f2d080b8a50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d10031440 tx=0x7f2d10009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:00.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.362+0000 7f2d1cff9640 1 -- 172.21.15.29:0/2011147091 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d14014030 con 0x7f2d201094a0 2024-09-21T07:07:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.595+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d2010bbc0 con 0x7f2d201094a0 2024-09-21T07:07:00.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.596+0000 7f2d1cff9640 1 -- 172.21.15.29:0/2011147091 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f2d140adc30 con 0x7f2d201094a0 2024-09-21T07:07:00.599 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:00.599 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":4,"btime":"2024-09-21T07:06:58:696487+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T07:07:00.599 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 4 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d080b6540 msgr2=0x7f2d080b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d080b6540 0x7f2d080b8a50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d10031440 tx=0x7f2d10009560 comp rx=0 tx=0).stop 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d201094a0 msgr2=0x7f2d2019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d201094a0 0x7f2d2019aa00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c8c0 tx=0x7f2d1400cd80 comp rx=0 tx=0).stop 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 shutdown_connections 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d080b6540 0x7f2d080b8a50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d20109df0 0x7f2d2019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d201094a0 0x7f2d2019aa00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 --2- 172.21.15.29:0/2011147091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d20103b60 0x7f2d2019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 >> 172.21.15.29:0/2011147091 conn(0x7f2d2007b850 msgr2=0x7f2d20107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 shutdown_connections 2024-09-21T07:07:00.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:00.598+0000 7f2d26015640 1 -- 172.21.15.29:0/2011147091 wait complete. 2024-09-21T07:07:01.284 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:01 smithi029 ceph-mon[30983]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:01.284 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:01 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2011147091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:01.285 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 21 07:07:01 smithi029 systemd[1]: Started Ceph mds.d for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:01 smithi066 ceph-mon[34793]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:01 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2011147091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:01.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:01 smithi052 ceph-mon[34308]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:01.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:01 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2011147091' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:02.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:02.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:02.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:02.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: Deploying daemon mds.e on smithi052 2024-09-21T07:07:02.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.29:6836/528626993,v1:172.21.15.29:6837/528626993] up:boot 2024-09-21T07:07:02.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: fsmap 4 up:standby 2024-09-21T07:07:02.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:02 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:07:02.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:02.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:02.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:02.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: Deploying daemon mds.e on smithi052 2024-09-21T07:07:02.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.29:6836/528626993,v1:172.21.15.29:6837/528626993] up:boot 2024-09-21T07:07:02.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: fsmap 4 up:standby 2024-09-21T07:07:02.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:02 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:07:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:02.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: Deploying daemon mds.e on smithi052 2024-09-21T07:07:02.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.29:6836/528626993,v1:172.21.15.29:6837/528626993] up:boot 2024-09-21T07:07:02.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: fsmap 4 up:standby 2024-09-21T07:07:02.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:02 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T07:07:03.425 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:03 smithi052 ceph-mon[34308]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:03 smithi066 ceph-mon[34793]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:03.619 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:07:03.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:03 smithi029 ceph-mon[30983]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:03.683 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:07:03 smithi052 podman[61689]: 2024-09-21 07:07:03.648677254 +0000 UTC m=+0.338319593 container start 834b2ca3bb2dbdd5a386e40c2811092ecb57d7bab57d506a26b1613b675715f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T07:07:03.683 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:07:03 smithi052 ceph-mds[61708]: -- 172.21.15.52:0/1196647688 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ea2bfb860 con 0x555ea6da3600 2024-09-21T07:07:03.888 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:03.993 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:07:03 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e[61704]: starting mds.e at 2024-09-21T07:07:03.993 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:07:03 smithi052 bash[61689]: 834b2ca3bb2dbdd5a386e40c2811092ecb57d7bab57d506a26b1613b675715f9 2024-09-21T07:07:03.993 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:07:03 smithi052 systemd[1]: Started Ceph mds.e for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 -- 172.21.15.29:0/312424406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 msgr2=0x7fb304102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/312424406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304102e70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb300009900 tx=0x7fb30002a410 comp rx=0 tx=0).stop 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 -- 172.21.15.29:0/312424406 shutdown_connections 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/312424406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb304108cf0 0x7fb30410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/312424406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3041083a0 0x7fb3041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/312424406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304102e70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 -- 172.21.15.29:0/312424406 >> 172.21.15.29:0/312424406 conn(0x7fb304079730 msgr2=0x7fb304079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 -- 172.21.15.29:0/312424406 shutdown_connections 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.427+0000 7fb30c5e2640 1 -- 172.21.15.29:0/312424406 wait complete. 2024-09-21T07:07:04.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 Processor -- start 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 -- start start 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3041083a0 0x7fb304104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb304108cf0 0x7fb304104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb304112960 con 0x7fb304102a60 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb3041127e0 con 0x7fb304108cf0 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30c5e2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb304112ae0 con 0x7fb3041083a0 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30a37e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30a37e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304104250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53648/0 (socket says 172.21.15.29:53648) 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.428+0000 7fb30a37e640 1 -- 172.21.15.29:0/3057136125 learned_addr learned my addr 172.21.15.29:0/3057136125 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30ab7f640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb304108cf0 0x7fb304104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:04.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb309b7d640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3041083a0 0x7fb304104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30a37e640 1 -- 172.21.15.29:0/3057136125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3041083a0 msgr2=0x7fb304104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30a37e640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3041083a0 0x7fb304104790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30a37e640 1 -- 172.21.15.29:0/3057136125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb304108cf0 msgr2=0x7fb304104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30a37e640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb304108cf0 0x7fb304104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30a37e640 1 -- 172.21.15.29:0/3057136125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3041a87e0 con 0x7fb304102a60 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb309b7d640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3041083a0 0x7fb304104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30a37e640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304104250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb300005940 tx=0x7fb3000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb2fb7fe640 1 -- 172.21.15.29:0/3057136125 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30003f030 con 0x7fb304102a60 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3041a8a70 con 0x7fb304102a60 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb2fb7fe640 1 -- 172.21.15.29:0/3057136125 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb300003cb0 con 0x7fb304102a60 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb2fb7fe640 1 -- 172.21.15.29:0/3057136125 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300035070 con 0x7fb304102a60 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.429+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3041a8f50 con 0x7fb304102a60 2024-09-21T07:07:04.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.430+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb304102e70 con 0x7fb304102a60 2024-09-21T07:07:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.432+0000 7fb2fb7fe640 1 -- 172.21.15.29:0/3057136125 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb300042030 con 0x7fb304102a60 2024-09-21T07:07:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.432+0000 7fb2fb7fe640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb2f00b6510 0x7fb2f00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.433+0000 7fb309b7d640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb2f00b6510 0x7fb2f00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.433+0000 7fb2fb7fe640 1 -- 172.21.15.29:0/3057136125 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb3001076e0 con 0x7fb304102a60 2024-09-21T07:07:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.433+0000 7fb309b7d640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb2f00b6510 0x7fb2f00b8a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40058c0 tx=0x7fb2f4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:04.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.437+0000 7fb2fb7fe640 1 -- 172.21.15.29:0/3057136125 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3000ce410 con 0x7fb304102a60 2024-09-21T07:07:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.666+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3041a9290 con 0x7fb304102a60 2024-09-21T07:07:04.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.667+0000 7fb2fb7fe640 1 -- 172.21.15.29:0/3057136125 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7fb3000d27f0 con 0x7fb304102a60 2024-09-21T07:07:04.669 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"btime":"2024-09-21T07:07:04:219922+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T07:07:04.670 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb2f00b6510 msgr2=0x7fb2f00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb2f00b6510 0x7fb2f00b8a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb2f40058c0 tx=0x7fb2f4005850 comp rx=0 tx=0).stop 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 msgr2=0x7fb304104250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304104250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb300005940 tx=0x7fb3000042f0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 shutdown_connections 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb2f00b6510 0x7fb2f00b8a20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb304108cf0 0x7fb304104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3041083a0 0x7fb304104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 --2- 172.21.15.29:0/3057136125 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb304102a60 0x7fb304104250 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 >> 172.21.15.29:0/3057136125 conn(0x7fb304079730 msgr2=0x7fb304101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:04.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 shutdown_connections 2024-09-21T07:07:04.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:04.669+0000 7fb30c5e2640 1 -- 172.21.15.29:0/3057136125 wait complete. 2024-09-21T07:07:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:04.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: Deploying daemon mds.f on smithi066 2024-09-21T07:07:04.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:04.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] up:boot 2024-09-21T07:07:04.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: fsmap 5 up:standby 2024-09-21T07:07:04.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:07:04.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:04 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3057136125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:05.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: Deploying daemon mds.f on smithi066 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] up:boot 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: fsmap 5 up:standby 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:07:05.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:04 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3057136125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: Deploying daemon mds.f on smithi066 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] up:boot 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: fsmap 5 up:standby 2024-09-21T07:07:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:07:05.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:04 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3057136125' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:05.851 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:05 smithi066 systemd[1]: Starting Ceph mds.f for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:07:06.196 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:05 smithi066 podman[63935]: 2024-09-21 07:07:05.826062487 +0000 UTC m=+0.016400296 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:07:06.196 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:05 smithi066 podman[63935]: 2024-09-21 07:07:05.934597629 +0000 UTC m=+0.124935426 container create 29fd867fb3be5eb48143f77c26720524620c4aaeaffc09f2725f5a370cc097df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:07:06.196 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:06 smithi066 podman[63935]: 2024-09-21 07:07:06.195264551 +0000 UTC m=+0.385602348 container init 29fd867fb3be5eb48143f77c26720524620c4aaeaffc09f2725f5a370cc097df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T07:07:06.601 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:06 smithi066 podman[63935]: 2024-09-21 07:07:06.198349551 +0000 UTC m=+0.388687348 container start 29fd867fb3be5eb48143f77c26720524620c4aaeaffc09f2725f5a370cc097df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T07:07:06.601 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:06 smithi066 ceph-mds[63954]: -- 172.21.15.66:0/3787938749 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563e03df5c20 con 0x563e07f9d600 2024-09-21T07:07:06.601 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:06 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f[63950]: starting mds.f at 2024-09-21T07:07:06.601 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:06 smithi066 bash[63935]: 29fd867fb3be5eb48143f77c26720524620c4aaeaffc09f2725f5a370cc097df 2024-09-21T07:07:06.601 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:07:06 smithi066 systemd[1]: Started Ceph mds.f for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:07.575 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:07:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: Deploying daemon mds.c on smithi066 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6834/1200693038,v1:172.21.15.66:6835/1200693038] up:boot 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: fsmap 6 up:standby 2024-09-21T07:07:07.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:07 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: Deploying daemon mds.c on smithi066 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6834/1200693038,v1:172.21.15.66:6835/1200693038] up:boot 2024-09-21T07:07:07.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: fsmap 6 up:standby 2024-09-21T07:07:07.605 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:07 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:07:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:07.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: Deploying daemon mds.c on smithi066 2024-09-21T07:07:07.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6834/1200693038,v1:172.21.15.66:6835/1200693038] up:boot 2024-09-21T07:07:07.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: fsmap 6 up:standby 2024-09-21T07:07:07.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:07 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:07:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:08.351 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 systemd[1]: Starting Ceph mds.c for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:07:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 -- 172.21.15.29:0/3085020282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f41094a0 msgr2=0x7fb0f41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/3085020282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f41094a0 0x7fb0f41098b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009900 tx=0x7fb0e802a410 comp rx=0 tx=0).stop 2024-09-21T07:07:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 -- 172.21.15.29:0/3085020282 shutdown_connections 2024-09-21T07:07:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/3085020282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f4109df0 0x7fb0f4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/3085020282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f41094a0 0x7fb0f41098b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/3085020282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4103b60 0x7fb0f4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 -- 172.21.15.29:0/3085020282 >> 172.21.15.29:0/3085020282 conn(0x7fb0f407b850 msgr2=0x7fb0f407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 -- 172.21.15.29:0/3085020282 shutdown_connections 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.321+0000 7fb0fb15b640 1 -- 172.21.15.29:0/3085020282 wait complete. 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 Processor -- start 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 -- start start 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f4103b60 0x7fb0f419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f41094a0 0x7fb0f419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f4109df0 0x7fb0f419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4113b00 con 0x7fb0f4103b60 2024-09-21T07:07:08.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4113980 con 0x7fb0f41094a0 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0fb15b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4113c80 con 0x7fb0f4109df0 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f4103b60 0x7fb0f419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f4103b60 0x7fb0f419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49480/0 (socket says 172.21.15.29:49480) 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 -- 172.21.15.29:0/303249663 learned_addr learned my addr 172.21.15.29:0/303249663 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f96f8640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f4109df0 0x7fb0f419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f3fff640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f41094a0 0x7fb0f419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 -- 172.21.15.29:0/303249663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f4109df0 msgr2=0x7fb0f419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f4109df0 0x7fb0f419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 -- 172.21.15.29:0/303249663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f41094a0 msgr2=0x7fb0f419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f41094a0 0x7fb0f419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f8ef7640 1 -- 172.21.15.29:0/303249663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f41a03e0 con 0x7fb0f4103b60 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.322+0000 7fb0f96f8640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f4109df0 0x7fb0f419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.323+0000 7fb0f8ef7640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f4103b60 0x7fb0f419a470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400d950 tx=0x7fb0e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.323+0000 7fb0f1ffb640 1 -- 172.21.15.29:0/303249663 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4017030 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.323+0000 7fb0f1ffb640 1 -- 172.21.15.29:0/303249663 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0e4004020 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.323+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f41a06d0 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.323+0000 7fb0f1ffb640 1 -- 172.21.15.29:0/303249663 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40047a0 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.323+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f41a6e30 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.324+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f4103f70 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.326+0000 7fb0f1ffb640 1 -- 172.21.15.29:0/303249663 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb0e4009a30 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.326+0000 7fb0f1ffb640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb0dc0b6510 0x7fb0dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.327+0000 7fb0f3fff640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb0dc0b6510 0x7fb0dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.327+0000 7fb0f1ffb640 1 -- 172.21.15.29:0/303249663 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb0e40e69d0 con 0x7fb0f4103b60 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.327+0000 7fb0f3fff640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb0dc0b6510 0x7fb0dc0b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0f41064c0 tx=0x7fb0e8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.331+0000 7fb0f1ffb640 1 -- 172.21.15.29:0/303249663 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0e40ad700 con 0x7fb0f4103b60 2024-09-21T07:07:08.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.560+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0f419b5a0 con 0x7fb0f4103b60 2024-09-21T07:07:08.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.561+0000 7fb0f1ffb640 1 -- 172.21.15.29:0/303249663 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5557 (secure 0 0 0) 0x7fb0e4092e20 con 0x7fb0f4103b60 2024-09-21T07:07:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:08.563 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":7,"btime":"2024-09-21T07:07:07:029285+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T07:07:08.563 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 7 2024-09-21T07:07:08.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb0dc0b6510 msgr2=0x7fb0dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:08.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb0dc0b6510 0x7fb0dc0b8a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0f41064c0 tx=0x7fb0e8005fd0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f4103b60 msgr2=0x7fb0f419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:08.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f4103b60 0x7fb0f419a470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400d950 tx=0x7fb0e400de10 comp rx=0 tx=0).stop 2024-09-21T07:07:08.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 shutdown_connections 2024-09-21T07:07:08.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb0dc0b6510 0x7fb0dc0b8a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f4109df0 0x7fb0f419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f41094a0 0x7fb0f419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 --2- 172.21.15.29:0/303249663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0f4103b60 0x7fb0f419a470 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:08.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.563+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 >> 172.21.15.29:0/303249663 conn(0x7fb0f407b850 msgr2=0x7fb0f4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:08.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.564+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 shutdown_connections 2024-09-21T07:07:08.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:08.564+0000 7fb0fb15b640 1 -- 172.21.15.29:0/303249663 wait complete. 2024-09-21T07:07:08.718 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 podman[64207]: 2024-09-21 07:07:08.34376796 +0000 UTC m=+0.016634088 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:07:08.719 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 podman[64207]: 2024-09-21 07:07:08.454039126 +0000 UTC m=+0.126905255 container create 543836303f1a54b9bd4b18638afdb54840b60c1527df4da35ea610e5d1781c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T07:07:08.719 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 podman[64207]: 2024-09-21 07:07:08.681363237 +0000 UTC m=+0.354229367 container init 543836303f1a54b9bd4b18638afdb54840b60c1527df4da35ea610e5d1781c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T07:07:08.719 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 podman[64207]: 2024-09-21 07:07:08.684493343 +0000 UTC m=+0.357359470 container start 543836303f1a54b9bd4b18638afdb54840b60c1527df4da35ea610e5d1781c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T07:07:09.101 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 ceph-mds[64226]: -- 172.21.15.66:0/1707575396 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557574f93860 con 0x55757913ba80 2024-09-21T07:07:09.101 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c[64222]: starting mds.c at 2024-09-21T07:07:09.101 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 bash[64207]: 543836303f1a54b9bd4b18638afdb54840b60c1527df4da35ea610e5d1781c12 2024-09-21T07:07:09.101 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:07:08 smithi066 systemd[1]: Started Ceph mds.c for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/303249663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:09.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:09 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/303249663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:09.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:09.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:09 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/303249663' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:09 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:10.398 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:10 smithi066 ceph-mon[34793]: Deploying daemon mds.h on smithi052 2024-09-21T07:07:10.398 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:10 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] up:boot 2024-09-21T07:07:10.398 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:10 smithi066 ceph-mon[34793]: fsmap 7 up:standby 2024-09-21T07:07:10.399 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:10 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:07:10.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:10 smithi029 ceph-mon[30983]: Deploying daemon mds.h on smithi052 2024-09-21T07:07:10.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:10 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] up:boot 2024-09-21T07:07:10.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:10 smithi029 ceph-mon[30983]: fsmap 7 up:standby 2024-09-21T07:07:10.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:10 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:07:10.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:10 smithi052 ceph-mon[34308]: Deploying daemon mds.h on smithi052 2024-09-21T07:07:10.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:10 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] up:boot 2024-09-21T07:07:10.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:10 smithi052 ceph-mon[34308]: fsmap 7 up:standby 2024-09-21T07:07:10.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:10 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:07:11.151 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:10 smithi052 systemd[1]: Starting Ceph mds.h for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:07:11.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:07:11.404 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:11 smithi052 ceph-mon[34308]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:11.404 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 podman[61970]: 2024-09-21 07:07:11.0526508 +0000 UTC m=+0.015569692 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:07:11.404 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 podman[61970]: 2024-09-21 07:07:11.189345411 +0000 UTC m=+0.152264347 container create 49a5c53e6256cb911d6ac5d3404b9669cbe2f70fc0dbe84cd7296c15feef92f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:07:11.404 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 podman[61970]: 2024-09-21 07:07:11.400348807 +0000 UTC m=+0.363267688 container init 49a5c53e6256cb911d6ac5d3404b9669cbe2f70fc0dbe84cd7296c15feef92f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T07:07:11.405 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 podman[61970]: 2024-09-21 07:07:11.403148074 +0000 UTC m=+0.366066964 container start 49a5c53e6256cb911d6ac5d3404b9669cbe2f70fc0dbe84cd7296c15feef92f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T07:07:11.545 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:11.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:11 smithi066 ceph-mon[34793]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:11.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:11 smithi029 ceph-mon[30983]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:11.743 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 ceph-mds[61989]: -- 172.21.15.52:0/645918288 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55950c0ef860 con 0x559510297600 2024-09-21T07:07:11.744 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h[61985]: starting mds.h at 2024-09-21T07:07:11.745 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 bash[61970]: 49a5c53e6256cb911d6ac5d3404b9669cbe2f70fc0dbe84cd7296c15feef92f5 2024-09-21T07:07:11.745 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:07:11 smithi052 systemd[1]: Started Ceph mds.h for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:12.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2890909354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 msgr2=0x7f6d9810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2890909354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 0x7f6d9810f600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009ca0 tx=0x7f6d9002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2890909354 shutdown_connections 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2890909354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 0x7f6d9810f600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2890909354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d98105220 0x7f6d98105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2890909354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 0x7f6d98103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2890909354 >> 172.21.15.29:0/2890909354 conn(0x7f6d98079ea0 msgr2=0x7f6d9807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2890909354 shutdown_connections 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.039+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2890909354 wait complete. 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 Processor -- start 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 -- start start 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 0x7f6d9819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:12.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d98105220 0x7f6d9819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 0x7f6d9819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98112a60 con 0x7f6d98105b70 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d981128e0 con 0x7f6d98103210 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9e26a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98112be0 con 0x7f6d98105220 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 0x7f6d9819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9c807640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 0x7f6d9819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 0x7f6d9819b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:53818/0 (socket says 172.21.15.29:53818) 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d9c807640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 0x7f6d9819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49498/0 (socket says 172.21.15.29:49498) 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d977fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d98105220 0x7f6d9819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.040+0000 7f6d97fff640 1 -- 172.21.15.29:0/2183062068 learned_addr learned my addr 172.21.15.29:0/2183062068 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d977fe640 1 -- 172.21.15.29:0/2183062068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 msgr2=0x7f6d9819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d977fe640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 0x7f6d9819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d977fe640 1 -- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 msgr2=0x7f6d9819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d977fe640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 0x7f6d9819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d977fe640 1 -- 172.21.15.29:0/2183062068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d981a65a0 con 0x7f6d98105220 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d97fff640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 0x7f6d9819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d977fe640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d98105220 0x7f6d9819b850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d98075a60 tx=0x7f6d8c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d957fa640 1 -- 172.21.15.29:0/2183062068 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00cc40 con 0x7f6d98105220 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d981a6890 con 0x7f6d98105220 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d957fa640 1 -- 172.21.15.29:0/2183062068 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d8c00cde0 con 0x7f6d98105220 2024-09-21T07:07:12.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d957fa640 1 -- 172.21.15.29:0/2183062068 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c004a00 con 0x7f6d98105220 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.041+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d981a6dd0 con 0x7f6d98105220 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.042+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d98103620 con 0x7f6d98105220 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.044+0000 7f6d957fa640 1 -- 172.21.15.29:0/2183062068 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6d8c004ba0 con 0x7f6d98105220 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.045+0000 7f6d957fa640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6d800b6540 0x7f6d800b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.045+0000 7f6d97fff640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6d800b6540 0x7f6d800b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.045+0000 7f6d957fa640 1 -- 172.21.15.29:0/2183062068 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f6d8c0e6ea0 con 0x7f6d98105220 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.045+0000 7f6d97fff640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6d800b6540 0x7f6d800b8a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d981029d0 tx=0x7f6d8800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:12.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.048+0000 7f6d957fa640 1 -- 172.21.15.29:0/2183062068 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d8c0adbc0 con 0x7f6d98105220 2024-09-21T07:07:12.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.276+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d98102280 con 0x7f6d98105220 2024-09-21T07:07:12.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.277+0000 7f6d957fa640 1 -- 172.21.15.29:0/2183062068 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6382 (secure 0 0 0) 0x7f6d98102280 con 0x7f6d98105220 2024-09-21T07:07:12.279 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:12.279 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"btime":"2024-09-21T07:07:09:333333+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T07:07:12.280 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6d800b6540 msgr2=0x7f6d800b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6d800b6540 0x7f6d800b8a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6d981029d0 tx=0x7f6d8800b410 comp rx=0 tx=0).stop 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d98105220 msgr2=0x7f6d9819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d98105220 0x7f6d9819b850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6d98075a60 tx=0x7f6d8c00ee50 comp rx=0 tx=0).stop 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 shutdown_connections 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6d800b6540 0x7f6d800b8a50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d98105b70 0x7f6d9819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d98105220 0x7f6d9819b850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 --2- 172.21.15.29:0/2183062068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d98103210 0x7f6d9819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 >> 172.21.15.29:0/2183062068 conn(0x7f6d98079ea0 msgr2=0x7f6d98106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 shutdown_connections 2024-09-21T07:07:12.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:12.280+0000 7f6d9e26a640 1 -- 172.21.15.29:0/2183062068 wait complete. 2024-09-21T07:07:12.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: Deploying daemon mds.i on smithi066 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2183062068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] up:boot 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: fsmap 8 up:standby 2024-09-21T07:07:12.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:12 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:07:12.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: Deploying daemon mds.i on smithi066 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2183062068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] up:boot 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: fsmap 8 up:standby 2024-09-21T07:07:12.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:12 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: Deploying daemon mds.i on smithi066 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2183062068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] up:boot 2024-09-21T07:07:12.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: fsmap 8 up:standby 2024-09-21T07:07:12.995 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:12 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:07:13.578 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:13 smithi066 systemd[1]: Starting Ceph mds.i for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:07:13.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:13 smithi066 ceph-mon[34793]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:13.851 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:13 smithi066 podman[64489]: 2024-09-21 07:07:13.605789984 +0000 UTC m=+0.016742210 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:07:13.851 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:13 smithi066 podman[64489]: 2024-09-21 07:07:13.722724569 +0000 UTC m=+0.133676828 container create a44ed3600f5a4d4180b92f5629e35ef7aa414a5628973f8102635388ea8db60b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:07:13.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:13 smithi029 ceph-mon[30983]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:13.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:13 smithi052 ceph-mon[34308]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:14.351 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:13 smithi066 podman[64489]: 2024-09-21 07:07:13.966855363 +0000 UTC m=+0.377807580 container init a44ed3600f5a4d4180b92f5629e35ef7aa414a5628973f8102635388ea8db60b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:07:14.351 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:13 smithi066 podman[64489]: 2024-09-21 07:07:13.969630208 +0000 UTC m=+0.380582425 container start a44ed3600f5a4d4180b92f5629e35ef7aa414a5628973f8102635388ea8db60b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T07:07:14.351 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:14 smithi066 ceph-mds[64508]: -- 172.21.15.66:0/2596712895 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55688afb1860 con 0x55688f159a80 2024-09-21T07:07:14.351 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i[64504]: starting mds.i at 2024-09-21T07:07:14.352 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:14 smithi066 bash[64489]: a44ed3600f5a4d4180b92f5629e35ef7aa414a5628973f8102635388ea8db60b 2024-09-21T07:07:14.352 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:07:14 smithi066 systemd[1]: Started Ceph mds.i for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:14.991 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:07:15.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:15.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: Deploying daemon mds.g on smithi029 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] up:boot 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: fsmap 9 up:standby 2024-09-21T07:07:15.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:15 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: Deploying daemon mds.g on smithi029 2024-09-21T07:07:15.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] up:boot 2024-09-21T07:07:15.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: fsmap 9 up:standby 2024-09-21T07:07:15.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:15 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:07:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:15.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:15.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: Deploying daemon mds.g on smithi029 2024-09-21T07:07:15.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] up:boot 2024-09-21T07:07:15.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: fsmap 9 up:standby 2024-09-21T07:07:15.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:15 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:07:15.791 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 -- 172.21.15.29:0/1106795223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 msgr2=0x7fbf3c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 --2- 172.21.15.29:0/1106795223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c1098e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009900 tx=0x7fbf3002a410 comp rx=0 tx=0).stop 2024-09-21T07:07:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 -- 172.21.15.29:0/1106795223 shutdown_connections 2024-09-21T07:07:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 --2- 172.21.15.29:0/1106795223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf3c109e20 0x7fbf3c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 --2- 172.21.15.29:0/1106795223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c1098e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 --2- 172.21.15.29:0/1106795223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf3c103b90 0x7fbf3c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 -- 172.21.15.29:0/1106795223 >> 172.21.15.29:0/1106795223 conn(0x7fbf3c0ff600 msgr2=0x7fbf3c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 -- 172.21.15.29:0/1106795223 shutdown_connections 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.582+0000 7fbf41d38640 1 -- 172.21.15.29:0/1106795223 wait complete. 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 Processor -- start 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 -- start start 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf3c103b90 0x7fbf3c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf3c109e20 0x7fbf3c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c113ae0 con 0x7fbf3c1094d0 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c113960 con 0x7fbf3c109e20 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf41d38640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c113c60 con 0x7fbf3c103b90 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf3affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf3affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:49524/0 (socket says 172.21.15.29:49524) 2024-09-21T07:07:16.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf3affd640 1 -- 172.21.15.29:0/2745323246 learned_addr learned my addr 172.21.15.29:0/2745323246 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:16.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.583+0000 7fbf3b7fe640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf3c103b90 0x7fbf3c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:16.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf3bfff640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf3c109e20 0x7fbf3c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:16.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf3affd640 1 -- 172.21.15.29:0/2745323246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf3c103b90 msgr2=0x7fbf3c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf3affd640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf3c103b90 0x7fbf3c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf3affd640 1 -- 172.21.15.29:0/2745323246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf3c109e20 msgr2=0x7fbf3c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf3affd640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf3c109e20 0x7fbf3c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf3affd640 1 -- 172.21.15.29:0/2745323246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c1a0400 con 0x7fbf3c1094d0 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf3affd640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c19aa30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006010 tx=0x7fbf30004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf38ff9640 1 -- 172.21.15.29:0/2745323246 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3003f030 con 0x7fbf3c1094d0 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c1a0690 con 0x7fbf3c1094d0 2024-09-21T07:07:16.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf38ff9640 1 -- 172.21.15.29:0/2745323246 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf30003aa0 con 0x7fbf3c1094d0 2024-09-21T07:07:16.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf38ff9640 1 -- 172.21.15.29:0/2745323246 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30035070 con 0x7fbf3c1094d0 2024-09-21T07:07:16.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.584+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c1a6e50 con 0x7fbf3c1094d0 2024-09-21T07:07:16.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.586+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c104e10 con 0x7fbf3c1094d0 2024-09-21T07:07:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.587+0000 7fbf38ff9640 1 -- 172.21.15.29:0/2745323246 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbf30042030 con 0x7fbf3c1094d0 2024-09-21T07:07:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.588+0000 7fbf38ff9640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fbf240b6590 0x7fbf240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.588+0000 7fbf3b7fe640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fbf240b6590 0x7fbf240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.588+0000 7fbf38ff9640 1 -- 172.21.15.29:0/2745323246 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fbf30107200 con 0x7fbf3c1094d0 2024-09-21T07:07:16.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.589+0000 7fbf3b7fe640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fbf240b6590 0x7fbf240b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c005fd0 tx=0x7fbf2c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:16.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.593+0000 7fbf38ff9640 1 -- 172.21.15.29:0/2745323246 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf300d2310 con 0x7fbf3c1094d0 2024-09-21T07:07:16.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.829+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf3c103fa0 con 0x7fbf3c1094d0 2024-09-21T07:07:16.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.829+0000 7fbf38ff9640 1 -- 172.21.15.29:0/2745323246 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8034 (secure 0 0 0) 0x7fbf300d7250 con 0x7fbf3c1094d0 2024-09-21T07:07:16.831 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:16.831 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"btime":"2024-09-21T07:07:14:577094+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:07:16.832 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 10 2024-09-21T07:07:16.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.831+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fbf240b6590 msgr2=0x7fbf240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:16.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.831+0000 7fbf41d38640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fbf240b6590 0x7fbf240b8aa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c005fd0 tx=0x7fbf2c00b390 comp rx=0 tx=0).stop 2024-09-21T07:07:16.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.831+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 msgr2=0x7fbf3c19aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.831+0000 7fbf41d38640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c19aa30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006010 tx=0x7fbf30004060 comp rx=0 tx=0).stop 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 shutdown_connections 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fbf240b6590 0x7fbf240b8aa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf3c109e20 0x7fbf3c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf3c1094d0 0x7fbf3c19aa30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 --2- 172.21.15.29:0/2745323246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf3c103b90 0x7fbf3c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 >> 172.21.15.29:0/2745323246 conn(0x7fbf3c0ff600 msgr2=0x7fbf3c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 shutdown_connections 2024-09-21T07:07:16.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:16.832+0000 7fbf41d38640 1 -- 172.21.15.29:0/2745323246 wait complete. 2024-09-21T07:07:17.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:17 smithi029 ceph-mon[30983]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:17.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:17 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2745323246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:17 smithi052 ceph-mon[34308]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:17 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2745323246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:17 smithi066 ceph-mon[34793]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:17 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2745323246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:17.840 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:07:17 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g[69911]: starting mds.g at 2024-09-21T07:07:18.121 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:07:17 smithi029 bash[69881]: 982831d4212101ac2d79e4df446e8e8ca010aa763235666fc7a69e138679f541 2024-09-21T07:07:18.121 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:07:17 smithi029 systemd[1]: Started Ceph mds.g for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: Deploying daemon mds.a on smithi029 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:19.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.29:6838/3672589136,v1:172.21.15.29:6839/3672589136] up:boot 2024-09-21T07:07:19.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: fsmap 10 up:standby 2024-09-21T07:07:19.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:18 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:07:19.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:19.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:19.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:19.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: Deploying daemon mds.a on smithi029 2024-09-21T07:07:19.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:19.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.29:6838/3672589136,v1:172.21.15.29:6839/3672589136] up:boot 2024-09-21T07:07:19.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: fsmap 10 up:standby 2024-09-21T07:07:19.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:18 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:07:19.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: Deploying daemon mds.a on smithi029 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.29:6838/3672589136,v1:172.21.15.29:6839/3672589136] up:boot 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: fsmap 10 up:standby 2024-09-21T07:07:19.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:18 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:07:19.598 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:07:19.948 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:20.072 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:19 smithi029 systemd[1]: Starting Ceph mds.a for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:07:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 -- 172.21.15.29:0/4175730347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac1030f0 msgr2=0x7f22ac103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/4175730347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac1030f0 0x7f22ac103500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f229c009900 tx=0x7f229c02a410 comp rx=0 tx=0).stop 2024-09-21T07:07:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 -- 172.21.15.29:0/4175730347 shutdown_connections 2024-09-21T07:07:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/4175730347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22ac105ac0 0x7f22ac10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/4175730347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac105170 0x7f22ac105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/4175730347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac1030f0 0x7f22ac103500 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 -- 172.21.15.29:0/4175730347 >> 172.21.15.29:0/4175730347 conn(0x7f22ac077bc0 msgr2=0x7f22ac078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 -- 172.21.15.29:0/4175730347 shutdown_connections 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.437+0000 7f22b1c6e640 1 -- 172.21.15.29:0/4175730347 wait complete. 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 Processor -- start 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 -- start start 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac1030f0 0x7f22ac199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22ac105170 0x7f22ac199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac105ac0 0x7f22ac199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac1129c0 con 0x7f22ac105ac0 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac112840 con 0x7f22ac105170 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22b1c6e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac112b40 con 0x7f22ac1030f0 2024-09-21T07:07:20.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac105ac0 0x7f22ac199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac105ac0 0x7f22ac199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43830/0 (socket says 172.21.15.29:43830) 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22abfff640 1 -- 172.21.15.29:0/380639407 learned_addr learned my addr 172.21.15.29:0/380639407 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.438+0000 7f22ab7fe640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac1030f0 0x7f22ac199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22a3fff640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22ac105170 0x7f22ac199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22abfff640 1 -- 172.21.15.29:0/380639407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac1030f0 msgr2=0x7f22ac199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22abfff640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac1030f0 0x7f22ac199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22abfff640 1 -- 172.21.15.29:0/380639407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22ac105170 msgr2=0x7f22ac199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22abfff640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22ac105170 0x7f22ac199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22abfff640 1 -- 172.21.15.29:0/380639407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac1a87d0 con 0x7f22ac105ac0 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22abfff640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac105ac0 0x7f22ac199ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22a400cad0 tx=0x7f22a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:20.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22a97fa640 1 -- 172.21.15.29:0/380639407 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a400ae20 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac1a8ac0 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22a97fa640 1 -- 172.21.15.29:0/380639407 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22a4005020 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22a97fa640 1 -- 172.21.15.29:0/380639407 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a400f6b0 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.439+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac1a8fb0 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.440+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22ac103500 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.442+0000 7f22a97fa640 1 -- 172.21.15.29:0/380639407 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f22a40051d0 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.443+0000 7f22a97fa640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22980b6510 0x7f22980b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.443+0000 7f22ab7fe640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22980b6510 0x7f22980b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.443+0000 7f22a97fa640 1 -- 172.21.15.29:0/380639407 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f22a40e72c0 con 0x7f22ac105ac0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.443+0000 7f22ab7fe640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22980b6510 0x7f22980b8a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f229c000c00 tx=0x7f229c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:20.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.446+0000 7f22a97fa640 1 -- 172.21.15.29:0/380639407 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22a4014030 con 0x7f22ac105ac0 2024-09-21T07:07:20.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.699+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22ac102160 con 0x7f22ac105ac0 2024-09-21T07:07:20.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.699+0000 7f22a97fa640 1 -- 172.21.15.29:0/380639407 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8860 (secure 0 0 0) 0x7f22ac102160 con 0x7f22ac105ac0 2024-09-21T07:07:20.701 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:20.702 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 11 2024-09-21T07:07:20.702 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":11,"btime":"2024-09-21T07:07:18:103668+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14814,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22980b6510 msgr2=0x7f22980b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22980b6510 0x7f22980b8a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f229c000c00 tx=0x7f229c031400 comp rx=0 tx=0).stop 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac105ac0 msgr2=0x7f22ac199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac105ac0 0x7f22ac199ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22a400cad0 tx=0x7f22a400cf90 comp rx=0 tx=0).stop 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 shutdown_connections 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f22980b6510 0x7f22980b8a20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22ac105ac0 0x7f22ac199ba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22ac105170 0x7f22ac199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 --2- 172.21.15.29:0/380639407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac1030f0 0x7f22ac199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 >> 172.21.15.29:0/380639407 conn(0x7f22ac077bc0 msgr2=0x7f22ac107000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 shutdown_connections 2024-09-21T07:07:20.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:20.702+0000 7f22b1c6e640 1 -- 172.21.15.29:0/380639407 wait complete. 2024-09-21T07:07:21.034 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:20 smithi029 podman[70263]: 2024-09-21 07:07:20.527490676 +0000 UTC m=+0.024040921 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:07:21.034 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:20 smithi029 podman[70263]: 2024-09-21 07:07:20.638818956 +0000 UTC m=+0.135369177 container create 941437d4438394afbd73abbf438b3f1020d6d28e19ed7fa3922b084da4923dd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:07:21.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:21 smithi052 ceph-mon[34308]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:21.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:21 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/380639407' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:21 smithi066 ceph-mon[34793]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:21.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:21 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/380639407' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:21.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:21 smithi029 ceph-mon[30983]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:21.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:21 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/380639407' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:21.371 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:21 smithi029 podman[70263]: 2024-09-21 07:07:21.09667775 +0000 UTC m=+0.593227985 container init 941437d4438394afbd73abbf438b3f1020d6d28e19ed7fa3922b084da4923dd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T07:07:21.371 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:21 smithi029 podman[70263]: 2024-09-21 07:07:21.100852078 +0000 UTC m=+0.597402307 container start 941437d4438394afbd73abbf438b3f1020d6d28e19ed7fa3922b084da4923dd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:07:21.371 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:21 smithi029 ceph-mds[70295]: -- 172.21.15.29:0/4152012019 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563ebada5860 con 0x563ebef4d180 2024-09-21T07:07:21.371 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:21 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a[70291]: starting mds.a at 2024-09-21T07:07:21.371 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:21 smithi029 bash[70263]: 941437d4438394afbd73abbf438b3f1020d6d28e19ed7fa3922b084da4923dd1 2024-09-21T07:07:21.372 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:07:21 smithi029 systemd[1]: Started Ceph mds.a for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:22.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:22.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:22.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:22.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: Deploying daemon mds.b on smithi052 2024-09-21T07:07:22.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.29:6840/659023126,v1:172.21.15.29:6841/659023126] up:boot 2024-09-21T07:07:22.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: fsmap 11 up:standby 2024-09-21T07:07:22.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:22 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:07:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:22.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:22.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: Deploying daemon mds.b on smithi052 2024-09-21T07:07:22.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.29:6840/659023126,v1:172.21.15.29:6841/659023126] up:boot 2024-09-21T07:07:22.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: fsmap 11 up:standby 2024-09-21T07:07:22.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:22 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:07:22.739 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.739 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.739 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:22.740 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T07:07:22.740 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T07:07:22.740 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:22.740 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: Deploying daemon mds.b on smithi052 2024-09-21T07:07:22.740 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.29:6840/659023126,v1:172.21.15.29:6841/659023126] up:boot 2024-09-21T07:07:22.740 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: fsmap 11 up:standby 2024-09-21T07:07:22.740 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:22 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:07:23.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:23 smithi052 ceph-mon[34308]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:23.493 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 systemd[1]: Starting Ceph mds.b for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:07:23.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:23 smithi066 ceph-mon[34793]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:23 smithi029 ceph-mon[30983]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:23.704 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:07:23.839 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 podman[62240]: 2024-09-21 07:07:23.476097178 +0000 UTC m=+0.015962894 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:07:23.839 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 podman[62240]: 2024-09-21 07:07:23.610159704 +0000 UTC m=+0.150025407 container create e0dcd70689bdced92bcec290c113bc5aa050b9724e270361fddc302377c87fa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T07:07:23.839 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 podman[62240]: 2024-09-21 07:07:23.837661284 +0000 UTC m=+0.377526991 container init e0dcd70689bdced92bcec290c113bc5aa050b9724e270361fddc302377c87fa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T07:07:23.981 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:24.243 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 podman[62240]: 2024-09-21 07:07:23.840672944 +0000 UTC m=+0.380538647 container start e0dcd70689bdced92bcec290c113bc5aa050b9724e270361fddc302377c87fa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:07:24.243 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 ceph-mds[62260]: -- 172.21.15.52:0/7132490 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597e8ea7860 con 0x5597ed04fa80 2024-09-21T07:07:24.243 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: starting mds.b at 2024-09-21T07:07:24.243 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 bash[62240]: e0dcd70689bdced92bcec290c113bc5aa050b9724e270361fddc302377c87fa4 2024-09-21T07:07:24.243 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:23 smithi052 systemd[1]: Started Ceph mds.b for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:07:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 -- 172.21.15.29:0/132675331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64102ae0 msgr2=0x7f0a64102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 --2- 172.21.15.29:0/132675331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64102ae0 0x7f0a64102ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009900 tx=0x7f0a5402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 -- 172.21.15.29:0/132675331 shutdown_connections 2024-09-21T07:07:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 --2- 172.21.15.29:0/132675331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a64108d70 0x7f0a6410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 --2- 172.21.15.29:0/132675331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a64108420 0x7f0a64108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 --2- 172.21.15.29:0/132675331 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64102ae0 0x7f0a64102ef0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 -- 172.21.15.29:0/132675331 >> 172.21.15.29:0/132675331 conn(0x7f0a64079770 msgr2=0x7f0a64079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 -- 172.21.15.29:0/132675331 shutdown_connections 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.456+0000 7f0a6a385640 1 -- 172.21.15.29:0/132675331 wait complete. 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 Processor -- start 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 -- start start 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a64102ae0 0x7f0a6419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64108420 0x7f0a6419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a64108d70 0x7f0a641a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64112a30 con 0x7f0a64108420 2024-09-21T07:07:24.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a641128b0 con 0x7f0a64102ae0 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a6a385640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0a64112bb0 con 0x7f0a64108d70 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64108420 0x7f0a6419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a5bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64108420 0x7f0a6419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43868/0 (socket says 172.21.15.29:43868) 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a5bfff640 1 -- 172.21.15.29:0/1500057689 learned_addr learned my addr 172.21.15.29:0/1500057689 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a68922640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a64108d70 0x7f0a641a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.457+0000 7f0a63fff640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a64102ae0 0x7f0a6419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a5bfff640 1 -- 172.21.15.29:0/1500057689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a64108d70 msgr2=0x7f0a641a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a5bfff640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a64108d70 0x7f0a641a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a5bfff640 1 -- 172.21.15.29:0/1500057689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a64102ae0 msgr2=0x7f0a6419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a5bfff640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a64102ae0 0x7f0a6419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a5bfff640 1 -- 172.21.15.29:0/1500057689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a641a26b0 con 0x7f0a64108420 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a63fff640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a64102ae0 0x7f0a6419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a5bfff640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64108420 0x7f0a6419cce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00d740 tx=0x7f0a4c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:24.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a61ffb640 1 -- 172.21.15.29:0/1500057689 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c017070 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a61ffb640 1 -- 172.21.15.29:0/1500057689 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c00de50 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a641a29a0 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a61ffb640 1 -- 172.21.15.29:0/1500057689 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00f620 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.458+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a641a9100 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.459+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a64103d60 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.461+0000 7f0a61ffb640 1 -- 172.21.15.29:0/1500057689 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0a4c01a070 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.461+0000 7f0a61ffb640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0a500b6510 0x7f0a500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.462+0000 7f0a63fff640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0a500b6510 0x7f0a500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.462+0000 7f0a61ffb640 1 -- 172.21.15.29:0/1500057689 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f0a4c0e6800 con 0x7f0a64108420 2024-09-21T07:07:24.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.462+0000 7f0a63fff640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0a500b6510 0x7f0a500b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a54031440 tx=0x7f0a54009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:24.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.465+0000 7f0a61ffb640 1 -- 172.21.15.29:0/1500057689 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a4c0ad530 con 0x7f0a64108420 2024-09-21T07:07:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.708+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a64102ef0 con 0x7f0a64108420 2024-09-21T07:07:24.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.709+0000 7f0a61ffb640 1 -- 172.21.15.29:0/1500057689 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7f0a64102ef0 con 0x7f0a64108420 2024-09-21T07:07:24.711 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:24.711 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"btime":"2024-09-21T07:07:24:278287+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14814,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14826,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T07:07:24.711 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0a500b6510 msgr2=0x7f0a500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0a500b6510 0x7f0a500b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a54031440 tx=0x7f0a54009680 comp rx=0 tx=0).stop 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64108420 msgr2=0x7f0a6419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64108420 0x7f0a6419cce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00d740 tx=0x7f0a4c00dc00 comp rx=0 tx=0).stop 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 shutdown_connections 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f0a500b6510 0x7f0a500b8a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a64108d70 0x7f0a641a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a64108420 0x7f0a6419cce0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 --2- 172.21.15.29:0/1500057689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a64102ae0 0x7f0a6419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 >> 172.21.15.29:0/1500057689 conn(0x7f0a64079770 msgr2=0x7f0a64106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 shutdown_connections 2024-09-21T07:07:24.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:24.711+0000 7f0a6a385640 1 -- 172.21.15.29:0/1500057689 wait complete. 2024-09-21T07:07:25.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:25.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:25.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] up:boot 2024-09-21T07:07:25.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: fsmap 12 up:standby 2024-09-21T07:07:25.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:07:25.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:24 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1500057689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:25.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:25.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:25.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] up:boot 2024-09-21T07:07:25.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: fsmap 12 up:standby 2024-09-21T07:07:25.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:07:25.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:24 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1500057689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] up:boot 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: fsmap 12 up:standby 2024-09-21T07:07:25.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:07:25.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:24 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1500057689' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:25.635 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T07:07:26.333 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:26.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:26 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:26 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:26 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.817+0000 7fef6ef86640 1 -- 172.21.15.29:0/218120169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef68109e40 msgr2=0x7fef68110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.817+0000 7fef6ef86640 1 --2- 172.21.15.29:0/218120169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef68109e40 0x7fef68110670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef60009ca0 tx=0x7fef6002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 -- 172.21.15.29:0/218120169 shutdown_connections 2024-09-21T07:07:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 --2- 172.21.15.29:0/218120169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef68109e40 0x7fef68110670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 --2- 172.21.15.29:0/218120169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef681094f0 0x7fef68109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 --2- 172.21.15.29:0/218120169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef68103bb0 0x7fef68103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:26.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 -- 172.21.15.29:0/218120169 >> 172.21.15.29:0/218120169 conn(0x7fef680ff600 msgr2=0x7fef68101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 -- 172.21.15.29:0/218120169 shutdown_connections 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 -- 172.21.15.29:0/218120169 wait complete. 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 Processor -- start 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.818+0000 7fef6ef86640 1 -- start start 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6ef86640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef68103bb0 0x7fef68075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6ef86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef681094f0 0x7fef68075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6ef86640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef68109e40 0x7fef68076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6ef86640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fef68113b50 con 0x7fef681094f0 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6ef86640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef681139d0 con 0x7fef68109e40 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6ef86640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fef68113cd0 con 0x7fef68103bb0 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef681094f0 0x7fef68075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef681094f0 0x7fef68075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43888/0 (socket says 172.21.15.29:43888) 2024-09-21T07:07:26.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 -- 172.21.15.29:0/425565310 learned_addr learned my addr 172.21.15.29:0/425565310 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6cd22640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef68103bb0 0x7fef68075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6d523640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef68109e40 0x7fef68076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 -- 172.21.15.29:0/425565310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef68103bb0 msgr2=0x7fef68075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef68103bb0 0x7fef68075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 -- 172.21.15.29:0/425565310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef68109e40 msgr2=0x7fef68076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef68109e40 0x7fef68076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 -- 172.21.15.29:0/425565310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef681a8720 con 0x7fef681094f0 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef6d523640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef68109e40 0x7fef68076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef67fff640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef681094f0 0x7fef68075c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fef5400d750 tx=0x7fef5400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.819+0000 7fef65ffb640 1 -- 172.21.15.29:0/425565310 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54017070 con 0x7fef681094f0 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.820+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef681a8a10 con 0x7fef681094f0 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.820+0000 7fef65ffb640 1 -- 172.21.15.29:0/425565310 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef540054d0 con 0x7fef681094f0 2024-09-21T07:07:26.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.820+0000 7fef65ffb640 1 -- 172.21.15.29:0/425565310 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54004c30 con 0x7fef681094f0 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.820+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef681a8f00 con 0x7fef681094f0 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.821+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef68103fc0 con 0x7fef681094f0 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.822+0000 7fef65ffb640 1 -- 172.21.15.29:0/425565310 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fef54004dd0 con 0x7fef681094f0 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.823+0000 7fef65ffb640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fef580b6510 0x7fef580b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.823+0000 7fef6cd22640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fef580b6510 0x7fef580b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.823+0000 7fef65ffb640 1 -- 172.21.15.29:0/425565310 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fef540e6cf0 con 0x7fef681094f0 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.824+0000 7fef6cd22640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fef580b6510 0x7fef580b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef68077160 tx=0x7fef5c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:26.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:26.826+0000 7fef65ffb640 1 -- 172.21.15.29:0/425565310 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef540ad980 con 0x7fef681094f0 2024-09-21T07:07:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.034+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fef6802e640 con 0x7fef681094f0 2024-09-21T07:07:27.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.034+0000 7fef65ffb640 1 -- 172.21.15.29:0/425565310 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7fef540b1d60 con 0x7fef681094f0 2024-09-21T07:07:27.036 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:27.037 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-09-21T07:07:27.037 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:07:27.037 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-09-21T07:07:27.037 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-09-21T07:07:27.037 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:07:27.037 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fef580b6510 msgr2=0x7fef580b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fef580b6510 0x7fef580b8a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fef68077160 tx=0x7fef5c00b390 comp rx=0 tx=0).stop 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef681094f0 msgr2=0x7fef68075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef681094f0 0x7fef68075c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fef5400d750 tx=0x7fef5400dc10 comp rx=0 tx=0).stop 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 shutdown_connections 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fef580b6510 0x7fef580b8a20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef68109e40 0x7fef68076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef681094f0 0x7fef68075c50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 --2- 172.21.15.29:0/425565310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef68103bb0 0x7fef68075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 >> 172.21.15.29:0/425565310 conn(0x7fef680ff600 msgr2=0x7fef68107ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 shutdown_connections 2024-09-21T07:07:27.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:27.038+0000 7fef6ef86640 1 -- 172.21.15.29:0/425565310 wait complete. 2024-09-21T07:07:27.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:27 smithi066 ceph-mon[34793]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:27.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:27 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:27.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:27 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/425565310' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:07:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:27 smithi029 ceph-mon[30983]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:27 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:27 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/425565310' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:07:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:27 smithi052 ceph-mon[34308]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:27 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:27 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/425565310' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T07:07:27.814 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:07:27.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:07:28.082 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 -- 172.21.15.29:0/1727099963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138102a70 msgr2=0x7f0138102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 --2- 172.21.15.29:0/1727099963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138102a70 0x7f0138102e80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0128009900 tx=0x7f012802a410 comp rx=0 tx=0).stop 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 -- 172.21.15.29:0/1727099963 shutdown_connections 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 --2- 172.21.15.29:0/1727099963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0138108d00 0x7f013810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 --2- 172.21.15.29:0/1727099963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01381083b0 0x7f01381087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 --2- 172.21.15.29:0/1727099963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138102a70 0x7f0138102e80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 -- 172.21.15.29:0/1727099963 >> 172.21.15.29:0/1727099963 conn(0x7f0138079730 msgr2=0x7f0138079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 -- 172.21.15.29:0/1727099963 shutdown_connections 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.573+0000 7f013e003640 1 -- 172.21.15.29:0/1727099963 wait complete. 2024-09-21T07:07:28.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.574+0000 7f013e003640 1 Processor -- start 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.574+0000 7f013e003640 1 -- start start 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f013e003640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138102a70 0x7f013819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f013e003640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01381083b0 0x7f013819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f013e003640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138108d00 0x7f013819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f013e003640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0138112970 con 0x7f0138108d00 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f013e003640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01381127f0 con 0x7f01381083b0 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f013e003640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0138112af0 con 0x7f0138102a70 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138108d00 0x7f013819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138108d00 0x7f013819bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39056/0 (socket says 172.21.15.29:39056) 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 -- 172.21.15.29:0/2684439706 learned_addr learned my addr 172.21.15.29:0/2684439706 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f01377fe640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138102a70 0x7f013819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f012effd640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01381083b0 0x7f013819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 -- 172.21.15.29:0/2684439706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138102a70 msgr2=0x7f013819b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138102a70 0x7f013819b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 -- 172.21.15.29:0/2684439706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01381083b0 msgr2=0x7f013819b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01381083b0 0x7f013819b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 -- 172.21.15.29:0/2684439706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01381a6530 con 0x7f0138108d00 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f012effd640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01381083b0 0x7f013819b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f0137fff640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138108d00 0x7f013819bca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f013000eaa0 tx=0x7f013000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.575+0000 7f01357fa640 1 -- 172.21.15.29:0/2684439706 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000cdb0 con 0x7f0138108d00 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.576+0000 7f01357fa640 1 -- 172.21.15.29:0/2684439706 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0130005020 con 0x7f0138108d00 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.576+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01381a6820 con 0x7f0138108d00 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.576+0000 7f01357fa640 1 -- 172.21.15.29:0/2684439706 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300116d0 con 0x7f0138108d00 2024-09-21T07:07:28.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.576+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01381a6d60 con 0x7f0138108d00 2024-09-21T07:07:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.577+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0138103cf0 con 0x7f0138108d00 2024-09-21T07:07:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.578+0000 7f01357fa640 1 -- 172.21.15.29:0/2684439706 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f01300051d0 con 0x7f0138108d00 2024-09-21T07:07:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.579+0000 7f01357fa640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f01240b6590 0x7f01240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.579+0000 7f01377fe640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f01240b6590 0x7f01240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.579+0000 7f01357fa640 1 -- 172.21.15.29:0/2684439706 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f01300e7050 con 0x7f0138108d00 2024-09-21T07:07:28.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.580+0000 7f01377fe640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f01240b6590 0x7f01240b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0128000c00 tx=0x7f0128031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:28.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.583+0000 7f01357fa640 1 -- 172.21.15.29:0/2684439706 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0130016030 con 0x7f0138108d00 2024-09-21T07:07:28.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:28.773+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f013802e640 con 0x7f0138108d00 2024-09-21T07:07:29.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:29.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:29.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:29.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:29.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:28 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2684439706' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:29.173 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:28 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2684439706' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:07:29.236 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:28 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2684439706' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T07:07:29.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.521+0000 7f01357fa640 1 -- 172.21.15.29:0/2684439706 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f01300adce0 con 0x7f0138108d00 2024-09-21T07:07:29.523 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f01240b6590 msgr2=0x7f01240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f01240b6590 0x7f01240b8aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0128000c00 tx=0x7f0128031400 comp rx=0 tx=0).stop 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138108d00 msgr2=0x7f013819bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138108d00 0x7f013819bca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f013000eaa0 tx=0x7f013000ef60 comp rx=0 tx=0).stop 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 shutdown_connections 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f01240b6590 0x7f01240b8aa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0138108d00 0x7f013819bca0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01381083b0 0x7f013819b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 --2- 172.21.15.29:0/2684439706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0138102a70 0x7f013819b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 >> 172.21.15.29:0/2684439706 conn(0x7f0138079730 msgr2=0x7f0138101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:29.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 shutdown_connections 2024-09-21T07:07:29.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:29.524+0000 7f013e003640 1 -- 172.21.15.29:0/2684439706 wait complete. 2024-09-21T07:07:30.363 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:07:30.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:30 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2684439706' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:07:30.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:30 smithi029 ceph-mon[30983]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:07:30.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:30 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:30 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:30 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:30 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.652 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:30.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:30 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2684439706' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:07:30.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:30 smithi066 ceph-mon[34793]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:07:30.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:30 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:30 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:30 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:30 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:30 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2684439706' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T07:07:30.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:30 smithi052 ceph-mon[34308]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T07:07:30.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:30 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:30 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:30 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:30.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:30 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/2664563039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac1083a0 msgr2=0x7f4eac1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:31.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/2664563039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac1083a0 0x7f4eac1087b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009900 tx=0x7f4ea002a410 comp rx=0 tx=0).stop 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/2664563039 shutdown_connections 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/2664563039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac108cf0 0x7f4eac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/2664563039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac1083a0 0x7f4eac1087b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/2664563039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac102a60 0x7f4eac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/2664563039 >> 172.21.15.29:0/2664563039 conn(0x7f4eac079730 msgr2=0x7f4eac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/2664563039 shutdown_connections 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.130+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/2664563039 wait complete. 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 Processor -- start 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 -- start start 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac102a60 0x7f4eac10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac1083a0 0x7f4eac1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac108cf0 0x7f4eac110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac113a80 con 0x7f4eac102a60 2024-09-21T07:07:31.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac113900 con 0x7f4eac108cf0 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb3bdb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac113c00 con 0x7f4eac1083a0 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb1977640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac102a60 0x7f4eac10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb1977640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac102a60 0x7f4eac10ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39066/0 (socket says 172.21.15.29:39066) 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb1977640 1 -- 172.21.15.29:0/174721951 learned_addr learned my addr 172.21.15.29:0/174721951 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb1176640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac1083a0 0x7f4eac1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.131+0000 7f4eb2178640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac108cf0 0x7f4eac110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb1977640 1 -- 172.21.15.29:0/174721951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac1083a0 msgr2=0x7f4eac1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb1977640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac1083a0 0x7f4eac1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb1977640 1 -- 172.21.15.29:0/174721951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac108cf0 msgr2=0x7f4eac110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb1977640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac108cf0 0x7f4eac110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb1977640 1 -- 172.21.15.29:0/174721951 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac1a87d0 con 0x7f4eac102a60 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb2178640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac108cf0 0x7f4eac110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:31.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb1977640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac102a60 0x7f4eac10ffb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00ea80 tx=0x7f4e9c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eaaffd640 1 -- 172.21.15.29:0/174721951 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c00ce40 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eaaffd640 1 -- 172.21.15.29:0/174721951 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e9c005020 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac1a8ac0 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eaaffd640 1 -- 172.21.15.29:0/174721951 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0116d0 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.132+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac1a8fd0 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.133+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac103ce0 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.135+0000 7f4eaaffd640 1 -- 172.21.15.29:0/174721951 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4e9c0054d0 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.136+0000 7f4eaaffd640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e940b6590 0x7f4e940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.136+0000 7f4eb1176640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e940b6590 0x7f4e940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.136+0000 7f4eaaffd640 1 -- 172.21.15.29:0/174721951 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7f4e9c0e7600 con 0x7f4eac102a60 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.136+0000 7f4eb1176640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e940b6590 0x7f4e940b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0000c00 tx=0x7f4ea0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:31.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.139+0000 7f4eaaffd640 1 -- 172.21.15.29:0/174721951 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e9c016030 con 0x7f4eac102a60 2024-09-21T07:07:31.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.341+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4eac102e70 con 0x7f4eac102a60 2024-09-21T07:07:31.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.531+0000 7f4eaaffd640 1 -- 172.21.15.29:0/174721951 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7f4e9c0ae240 con 0x7f4eac102a60 2024-09-21T07:07:31.533 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-09-21T07:07:31.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e940b6590 msgr2=0x7f4e940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:31.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e940b6590 0x7f4e940b8aa0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0000c00 tx=0x7f4ea0031400 comp rx=0 tx=0).stop 2024-09-21T07:07:31.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac102a60 msgr2=0x7f4eac10ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:31.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac102a60 0x7f4eac10ffb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00ea80 tx=0x7f4e9c00ef40 comp rx=0 tx=0).stop 2024-09-21T07:07:31.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 shutdown_connections 2024-09-21T07:07:31.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4e940b6590 0x7f4e940b8aa0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4eac108cf0 0x7f4eac110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4eac1083a0 0x7f4eac1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 --2- 172.21.15.29:0/174721951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4eac102a60 0x7f4eac10ffb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 >> 172.21.15.29:0/174721951 conn(0x7f4eac079730 msgr2=0x7f4eac105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 shutdown_connections 2024-09-21T07:07:31.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:31.534+0000 7f4eb3bdb640 1 -- 172.21.15.29:0/174721951 wait complete. 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: pgmap v286: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:31 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/174721951' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:07:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: pgmap v286: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:07:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:31.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:31 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/174721951' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: pgmap v286: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:07:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:31 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/174721951' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T07:07:32.209 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:07:32.472 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:32.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:32 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/174721951' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:07:32.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:32 smithi029 ceph-mon[30983]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:07:32.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:32 smithi029 ceph-mon[30983]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:07:32.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:32 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/174721951' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:07:32.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:32 smithi066 ceph-mon[34793]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:07:32.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:32 smithi066 ceph-mon[34793]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:07:32.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:32 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/174721951' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T07:07:32.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:32 smithi052 ceph-mon[34308]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T07:07:32.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:32 smithi052 ceph-mon[34308]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T07:07:33.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 -- 172.21.15.29:0/2471482249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84102ae0 msgr2=0x7fec84102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:33.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 --2- 172.21.15.29:0/2471482249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84102ae0 0x7fec84102ef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec74009900 tx=0x7fec7402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 -- 172.21.15.29:0/2471482249 shutdown_connections 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 --2- 172.21.15.29:0/2471482249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec84108d20 0x7fec8410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 --2- 172.21.15.29:0/2471482249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec841083d0 0x7fec841087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 --2- 172.21.15.29:0/2471482249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84102ae0 0x7fec84102ef0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 -- 172.21.15.29:0/2471482249 >> 172.21.15.29:0/2471482249 conn(0x7fec84079760 msgr2=0x7fec84079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 -- 172.21.15.29:0/2471482249 shutdown_connections 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.008+0000 7fec89149640 1 -- 172.21.15.29:0/2471482249 wait complete. 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 Processor -- start 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 -- start start 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec84102ae0 0x7fec8419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec841083d0 0x7fec8419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:33.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84108d20 0x7fec8419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fec84112990 con 0x7fec84108d20 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec84112810 con 0x7fec84102ae0 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec89149640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec84112b10 con 0x7fec841083d0 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84108d20 0x7fec8419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec8359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84108d20 0x7fec8419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39088/0 (socket says 172.21.15.29:39088) 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec8359e640 1 -- 172.21.15.29:0/3252671539 learned_addr learned my addr 172.21.15.29:0/3252671539 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec82d9d640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec84102ae0 0x7fec8419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.009+0000 7fec8259c640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec841083d0 0x7fec8419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec8359e640 1 -- 172.21.15.29:0/3252671539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec841083d0 msgr2=0x7fec8419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec8359e640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec841083d0 0x7fec8419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec8359e640 1 -- 172.21.15.29:0/3252671539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec84102ae0 msgr2=0x7fec8419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec8359e640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec84102ae0 0x7fec8419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec8359e640 1 -- 172.21.15.29:0/3252671539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec841a0400 con 0x7fec84108d20 2024-09-21T07:07:33.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec8359e640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84108d20 0x7fec8419fcd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009fd0 tx=0x7fec7c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec6bfff640 1 -- 172.21.15.29:0/3252671539 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c017070 con 0x7fec84108d20 2024-09-21T07:07:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec841a06f0 con 0x7fec84108d20 2024-09-21T07:07:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec6bfff640 1 -- 172.21.15.29:0/3252671539 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec7c003e20 con 0x7fec84108d20 2024-09-21T07:07:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec6bfff640 1 -- 172.21.15.29:0/3252671539 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c010460 con 0x7fec84108d20 2024-09-21T07:07:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.010+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec841a6e50 con 0x7fec84108d20 2024-09-21T07:07:33.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.011+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec84103d10 con 0x7fec84108d20 2024-09-21T07:07:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.013+0000 7fec6bfff640 1 -- 172.21.15.29:0/3252671539 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fec7c003970 con 0x7fec84108d20 2024-09-21T07:07:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.013+0000 7fec6bfff640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6510 0x7fec6c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.014+0000 7fec82d9d640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6510 0x7fec6c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.014+0000 7fec6bfff640 1 -- 172.21.15.29:0/3252671539 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7fec7c0e7230 con 0x7fec84108d20 2024-09-21T07:07:33.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.014+0000 7fec82d9d640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6510 0x7fec6c0b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec74031440 tx=0x7fec74009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:33.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.017+0000 7fec6bfff640 1 -- 172.21.15.29:0/3252671539 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec7c0b2050 con 0x7fec84108d20 2024-09-21T07:07:33.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.243+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fec84102ef0 con 0x7fec84108d20 2024-09-21T07:07:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.560+0000 7fec6bfff640 1 -- 172.21.15.29:0/3252671539 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fec84102ef0 con 0x7fec84108d20 2024-09-21T07:07:33.562 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:07:33.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.563+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6510 msgr2=0x7fec6c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:33.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.563+0000 7fec89149640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6510 0x7fec6c0b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec74031440 tx=0x7fec74009560 comp rx=0 tx=0).stop 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84108d20 msgr2=0x7fec8419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84108d20 0x7fec8419fcd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009fd0 tx=0x7fec7c00b260 comp rx=0 tx=0).stop 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 shutdown_connections 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fec6c0b6510 0x7fec6c0b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fec84108d20 0x7fec8419fcd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec841083d0 0x7fec8419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 --2- 172.21.15.29:0/3252671539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec84102ae0 0x7fec8419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 >> 172.21.15.29:0/3252671539 conn(0x7fec84079760 msgr2=0x7fec84101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:33.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 shutdown_connections 2024-09-21T07:07:33.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:33.564+0000 7fec89149640 1 -- 172.21.15.29:0/3252671539 wait complete. 2024-09-21T07:07:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:33 smithi066 ceph-mon[34793]: pgmap v289: 97 pgs: 1 creating+activating, 10 creating+peering, 72 unknown, 14 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:33 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3252671539' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:07:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:33 smithi066 ceph-mon[34793]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:07:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:33 smithi029 ceph-mon[30983]: pgmap v289: 97 pgs: 1 creating+activating, 10 creating+peering, 72 unknown, 14 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:33 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3252671539' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:07:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:33 smithi029 ceph-mon[30983]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:07:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:33 smithi052 ceph-mon[34308]: pgmap v289: 97 pgs: 1 creating+activating, 10 creating+peering, 72 unknown, 14 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:33 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3252671539' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T07:07:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:33 smithi052 ceph-mon[34308]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T07:07:34.284 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:07:34.548 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:34.824 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:34 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3252671539' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:07:34.825 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:34 smithi029 ceph-mon[30983]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:07:34.825 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:34 smithi029 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:07:34.825 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:34 smithi029 ceph-mon[30983]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:07:34.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:34 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3252671539' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:07:34.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:34 smithi066 ceph-mon[34793]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:07:34.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:34 smithi066 ceph-mon[34793]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:07:34.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:34 smithi066 ceph-mon[34793]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:07:34.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:34 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3252671539' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T07:07:34.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:34 smithi052 ceph-mon[34308]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T07:07:34.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:34 smithi052 ceph-mon[34308]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T07:07:34.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:34 smithi052 ceph-mon[34308]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T07:07:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 -- 172.21.15.29:0/2766871156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934102a60 msgr2=0x7f1934102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 --2- 172.21.15.29:0/2766871156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934102a60 0x7f1934102e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1924009900 tx=0x7f192402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 -- 172.21.15.29:0/2766871156 shutdown_connections 2024-09-21T07:07:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 --2- 172.21.15.29:0/2766871156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1934108cf0 0x7f193410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 --2- 172.21.15.29:0/2766871156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19341083a0 0x7f19341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 --2- 172.21.15.29:0/2766871156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934102a60 0x7f1934102e70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 -- 172.21.15.29:0/2766871156 >> 172.21.15.29:0/2766871156 conn(0x7f1934079760 msgr2=0x7f1934079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 -- 172.21.15.29:0/2766871156 shutdown_connections 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.032+0000 7f1939e15640 1 -- 172.21.15.29:0/2766871156 wait complete. 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 Processor -- start 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 -- start start 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1934102a60 0x7f19341993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19341083a0 0x7f1934199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934108cf0 0x7f193419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f19341129b0 con 0x7f1934108cf0 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1934112830 con 0x7f1934102a60 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1939e15640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1934112b30 con 0x7f19341083a0 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1933fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934108cf0 0x7f193419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1933fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934108cf0 0x7f193419ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39100/0 (socket says 172.21.15.29:39100) 2024-09-21T07:07:35.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f19337fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1934102a60 0x7f19341993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.033+0000 7f1933fff640 1 -- 172.21.15.29:0/423259348 learned_addr learned my addr 172.21.15.29:0/423259348 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f192affd640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19341083a0 0x7f1934199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1933fff640 1 -- 172.21.15.29:0/423259348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19341083a0 msgr2=0x7f1934199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1933fff640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19341083a0 0x7f1934199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1933fff640 1 -- 172.21.15.29:0/423259348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1934102a60 msgr2=0x7f19341993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1933fff640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1934102a60 0x7f19341993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1933fff640 1 -- 172.21.15.29:0/423259348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f193419f330 con 0x7f1934108cf0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1933fff640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934108cf0 0x7f193419ec00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f192c009fd0 tx=0x7f192c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f19317fa640 1 -- 172.21.15.29:0/423259348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c017070 con 0x7f1934108cf0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f19317fa640 1 -- 172.21.15.29:0/423259348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f192c003e20 con 0x7f1934108cf0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f193419f620 con 0x7f1934108cf0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f19317fa640 1 -- 172.21.15.29:0/423259348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c010460 con 0x7f1934108cf0 2024-09-21T07:07:35.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.034+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19341a5d80 con 0x7f1934108cf0 2024-09-21T07:07:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.035+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1934103ce0 con 0x7f1934108cf0 2024-09-21T07:07:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.037+0000 7f19317fa640 1 -- 172.21.15.29:0/423259348 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f192c003970 con 0x7f1934108cf0 2024-09-21T07:07:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.038+0000 7f19317fa640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f19200b6590 0x7f19200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.038+0000 7f19337fe640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f19200b6590 0x7f19200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.038+0000 7f19317fa640 1 -- 172.21.15.29:0/423259348 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f192c0e6e10 con 0x7f1934108cf0 2024-09-21T07:07:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.038+0000 7f19337fe640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f19200b6590 0x7f19200b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1924031440 tx=0x7f1924009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:35.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.041+0000 7f19317fa640 1 -- 172.21.15.29:0/423259348 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f192c0b1c50 con 0x7f1934108cf0 2024-09-21T07:07:35.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.230+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1934102e70 con 0x7f1934108cf0 2024-09-21T07:07:35.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.231+0000 7f19317fa640 1 -- 172.21.15.29:0/423259348 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22206 (secure 0 0 0) 0x7f1934102e70 con 0x7f1934108cf0 2024-09-21T07:07:35.233 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:35.233 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":73,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:33.244591+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:07:35.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f19200b6590 msgr2=0x7f19200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f19200b6590 0x7f19200b8aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1924031440 tx=0x7f1924009560 comp rx=0 tx=0).stop 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934108cf0 msgr2=0x7f193419ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934108cf0 0x7f193419ec00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f192c009fd0 tx=0x7f192c00b260 comp rx=0 tx=0).stop 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 shutdown_connections 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f19200b6590 0x7f19200b8aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1934108cf0 0x7f193419ec00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19341083a0 0x7f1934199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 --2- 172.21.15.29:0/423259348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1934102a60 0x7f19341993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 >> 172.21.15.29:0/423259348 conn(0x7f1934079760 msgr2=0x7f1934106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 shutdown_connections 2024-09-21T07:07:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:35.234+0000 7f1939e15640 1 -- 172.21.15.29:0/423259348 wait complete. 2024-09-21T07:07:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:35 smithi066 ceph-mon[34793]: pgmap v292: 97 pgs: 5 creating+activating, 14 creating+peering, 36 unknown, 42 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:35 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] up:active 2024-09-21T07:07:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:35 smithi066 ceph-mon[34793]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:35 smithi066 ceph-mon[34793]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:35 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/423259348' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:35 smithi029 ceph-mon[30983]: pgmap v292: 97 pgs: 5 creating+activating, 14 creating+peering, 36 unknown, 42 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:35 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] up:active 2024-09-21T07:07:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:35 smithi029 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:35 smithi029 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:35 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/423259348' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:35.909 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:07:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:35 smithi052 ceph-mon[34308]: pgmap v292: 97 pgs: 5 creating+activating, 14 creating+peering, 36 unknown, 42 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:07:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:35 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] up:active 2024-09-21T07:07:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:35 smithi052 ceph-mon[34308]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:35 smithi052 ceph-mon[34308]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:35 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/423259348' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:36.169 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:36.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 -- 172.21.15.29:0/1176619546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02810de10 msgr2=0x7fe028110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:36.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 --2- 172.21.15.29:0/1176619546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02810de10 0x7fe028110300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe020009ca0 tx=0x7fe02002a8e0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 -- 172.21.15.29:0/1176619546 shutdown_connections 2024-09-21T07:07:36.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 --2- 172.21.15.29:0/1176619546 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02810de10 0x7fe028110300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 --2- 172.21.15.29:0/1176619546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe028105300 0x7fe02810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 --2- 172.21.15.29:0/1176619546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0281049b0 0x7fe028104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 -- 172.21.15.29:0/1176619546 >> 172.21.15.29:0/1176619546 conn(0x7fe028079730 msgr2=0x7fe028079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 -- 172.21.15.29:0/1176619546 shutdown_connections 2024-09-21T07:07:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.643+0000 7fe02f479640 1 -- 172.21.15.29:0/1176619546 wait complete. 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 Processor -- start 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 -- start start 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0281049b0 0x7fe02819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028105300 0x7fe02819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02810de10 0x7fe02819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe028113ad0 con 0x7fe028105300 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe028113950 con 0x7fe02810de10 2024-09-21T07:07:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02f479640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe028113c50 con 0x7fe0281049b0 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02ca14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028105300 0x7fe02819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02ca14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028105300 0x7fe02819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39120/0 (socket says 172.21.15.29:39120) 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.644+0000 7fe02ca14640 1 -- 172.21.15.29:0/4133880877 learned_addr learned my addr 172.21.15.29:0/4133880877 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02d215640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0281049b0 0x7fe02819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02da16640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02810de10 0x7fe02819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02ca14640 1 -- 172.21.15.29:0/4133880877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0281049b0 msgr2=0x7fe02819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02ca14640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0281049b0 0x7fe02819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02ca14640 1 -- 172.21.15.29:0/4133880877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02810de10 msgr2=0x7fe02819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02ca14640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02810de10 0x7fe02819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02ca14640 1 -- 172.21.15.29:0/4133880877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0281a0330 con 0x7fe028105300 2024-09-21T07:07:36.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02da16640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02810de10 0x7fe02819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:36.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02ca14640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028105300 0x7fe02819aa20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe01800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:36.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe01e7fc640 1 -- 172.21.15.29:0/4133880877 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018011830 con 0x7fe028105300 2024-09-21T07:07:36.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0281a0620 con 0x7fe028105300 2024-09-21T07:07:36.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe01e7fc640 1 -- 172.21.15.29:0/4133880877 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe018016070 con 0x7fe028105300 2024-09-21T07:07:36.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe01e7fc640 1 -- 172.21.15.29:0/4133880877 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018010e00 con 0x7fe028105300 2024-09-21T07:07:36.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.645+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0281a6e40 con 0x7fe028105300 2024-09-21T07:07:36.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.646+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe028104dc0 con 0x7fe028105300 2024-09-21T07:07:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.648+0000 7fe01e7fc640 1 -- 172.21.15.29:0/4133880877 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe01801b460 con 0x7fe028105300 2024-09-21T07:07:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.649+0000 7fe01e7fc640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe0140b6540 0x7fe0140b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.649+0000 7fe02d215640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe0140b6540 0x7fe0140b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.649+0000 7fe01e7fc640 1 -- 172.21.15.29:0/4133880877 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fe0180e6d50 con 0x7fe028105300 2024-09-21T07:07:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.650+0000 7fe02d215640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe0140b6540 0x7fe0140b8a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe02806bc60 tx=0x7fe024005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:36.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.653+0000 7fe01e7fc640 1 -- 172.21.15.29:0/4133880877 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0180ad730 con 0x7fe028105300 2024-09-21T07:07:36.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.839+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0281a7100 con 0x7fe028105300 2024-09-21T07:07:36.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.841+0000 7fe01e7fc640 1 -- 172.21.15.29:0/4133880877 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22206 (secure 0 0 0) 0x7fe0180b1b10 con 0x7fe028105300 2024-09-21T07:07:36.843 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:36.843 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":73,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:33.244591+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:07:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe0140b6540 msgr2=0x7fe0140b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe0140b6540 0x7fe0140b8a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe02806bc60 tx=0x7fe024005f90 comp rx=0 tx=0).stop 2024-09-21T07:07:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028105300 msgr2=0x7fe02819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028105300 0x7fe02819aa20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe018006fd0 tx=0x7fe01800b8e0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 shutdown_connections 2024-09-21T07:07:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe0140b6540 0x7fe0140b8a50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe02810de10 0x7fe02819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028105300 0x7fe02819aa20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 --2- 172.21.15.29:0/4133880877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0281049b0 0x7fe02819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 >> 172.21.15.29:0/4133880877 conn(0x7fe028079730 msgr2=0x7fe0280ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 shutdown_connections 2024-09-21T07:07:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:36.843+0000 7fe02f479640 1 -- 172.21.15.29:0/4133880877 wait complete. 2024-09-21T07:07:37.541 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:07:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:37 smithi066 ceph-mon[34793]: pgmap v293: 97 pgs: 4 creating+activating, 12 creating+peering, 14 unknown, 67 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 2 op/s 2024-09-21T07:07:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:37 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4133880877' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:37 smithi029 ceph-mon[30983]: pgmap v293: 97 pgs: 4 creating+activating, 12 creating+peering, 14 unknown, 67 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 2 op/s 2024-09-21T07:07:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:37 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4133880877' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:37.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:37 smithi052 ceph-mon[34308]: pgmap v293: 97 pgs: 4 creating+activating, 12 creating+peering, 14 unknown, 67 active+clean; 578 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 2 op/s 2024-09-21T07:07:37.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:37 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4133880877' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.276+0000 7f1fef4a8640 1 -- 172.21.15.29:0/4209783306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8102880 msgr2=0x7f1fe8112500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.276+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/4209783306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8102880 0x7f1fe8112500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009ca0 tx=0x7f1fe002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.276+0000 7f1fef4a8640 1 -- 172.21.15.29:0/4209783306 shutdown_connections 2024-09-21T07:07:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.276+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/4209783306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8102880 0x7f1fe8112500 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.276+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/4209783306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe8101d50 0x7f1fe8102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.276+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/4209783306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8104690 0x7f1fe8104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.276+0000 7f1fef4a8640 1 -- 172.21.15.29:0/4209783306 >> 172.21.15.29:0/4209783306 conn(0x7f1fe8077bc0 msgr2=0x7f1fe8078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.277+0000 7f1fef4a8640 1 -- 172.21.15.29:0/4209783306 shutdown_connections 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.277+0000 7f1fef4a8640 1 -- 172.21.15.29:0/4209783306 wait complete. 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.277+0000 7f1fef4a8640 1 Processor -- start 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.277+0000 7f1fef4a8640 1 -- start start 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fef4a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe8101d50 0x7f1fe819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fef4a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8102880 0x7f1fe819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fef4a8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8104690 0x7f1fe81a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fef4a8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe8115c70 con 0x7f1fe8104690 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fef4a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe8115af0 con 0x7f1fe8102880 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fef4a8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe8115df0 con 0x7f1fe8101d50 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8104690 0x7f1fe81a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8104690 0x7f1fe81a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57884/0 (socket says 172.21.15.29:57884) 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 -- 172.21.15.29:0/502808149 learned_addr learned my addr 172.21.15.29:0/502808149 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fed244640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe8101d50 0x7f1fe819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feca43640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8102880 0x7f1fe819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 -- 172.21.15.29:0/502808149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe8101d50 msgr2=0x7f1fe819c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe8101d50 0x7f1fe819c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 -- 172.21.15.29:0/502808149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8102880 msgr2=0x7f1fe819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8102880 0x7f1fe819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 -- 172.21.15.29:0/502808149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe81a2530 con 0x7f1fe8104690 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1feda45640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8104690 0x7f1fe81a1e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0005cc0 tx=0x7f1fe002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fde7fc640 1 -- 172.21.15.29:0/502808149 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0003bf0 con 0x7f1fe8104690 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe81a27c0 con 0x7f1fe8104690 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.278+0000 7f1fde7fc640 1 -- 172.21.15.29:0/502808149 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fe0003d90 con 0x7f1fe8104690 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.279+0000 7f1fde7fc640 1 -- 172.21.15.29:0/502808149 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe002fbc0 con 0x7f1fe8104690 2024-09-21T07:07:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.279+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe81a8f80 con 0x7f1fe8104690 2024-09-21T07:07:38.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.279+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe8102160 con 0x7f1fe8104690 2024-09-21T07:07:38.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.281+0000 7f1fde7fc640 1 -- 172.21.15.29:0/502808149 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1fe002fd60 con 0x7f1fe8104690 2024-09-21T07:07:38.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.282+0000 7f1fde7fc640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fd40b6510 0x7f1fd40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:38.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.282+0000 7f1fed244640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fd40b6510 0x7f1fd40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:38.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.282+0000 7f1fde7fc640 1 -- 172.21.15.29:0/502808149 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f1fe0108850 con 0x7f1fe8104690 2024-09-21T07:07:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.283+0000 7f1fed244640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fd40b6510 0x7f1fd40b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4005d00 tx=0x7f1fe400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.285+0000 7f1fde7fc640 1 -- 172.21.15.29:0/502808149 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1fe00cf230 con 0x7f1fe8104690 2024-09-21T07:07:38.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.512+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1fe819d6f0 con 0x7f1fe8104690 2024-09-21T07:07:38.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.582+0000 7f1fde7fc640 1 -- 172.21.15.29:0/502808149 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f1fe819d6f0 con 0x7f1fe8104690 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fd40b6510 msgr2=0x7f1fd40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fd40b6510 0x7f1fd40b8a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4005d00 tx=0x7f1fe400b410 comp rx=0 tx=0).stop 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8104690 msgr2=0x7f1fe81a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8104690 0x7f1fe81a1e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0005cc0 tx=0x7f1fe002f380 comp rx=0 tx=0).stop 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 shutdown_connections 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fd40b6510 0x7f1fd40b8a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fe8104690 0x7f1fe81a1e00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fe8102880 0x7f1fe819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 --2- 172.21.15.29:0/502808149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe8101d50 0x7f1fe819c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:38.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 >> 172.21.15.29:0/502808149 conn(0x7f1fe8077bc0 msgr2=0x7f1fe8100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:38.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 shutdown_connections 2024-09-21T07:07:38.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:38.584+0000 7f1fef4a8640 1 -- 172.21.15.29:0/502808149 wait complete. 2024-09-21T07:07:38.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:38 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/502808149' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:07:38.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:38 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/502808149' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:07:38.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:38 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/502808149' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T07:07:39.314 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T07:07:39.314 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T07:07:39.579 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:39.585 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:39 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: 2024-09-21T07:07:39.286+0000 7fd745ad5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:07:39.849 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:39 smithi029 ceph-mon[30983]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-21T07:07:39.850 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:39 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/502808149' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:07:39.850 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:39 smithi029 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:39 smithi066 ceph-mon[34793]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-21T07:07:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:39 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/502808149' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:07:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:39 smithi066 ceph-mon[34793]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:39.869 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:39 smithi052 ceph-mon[34308]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-21T07:07:39.869 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:39 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/502808149' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T07:07:39.869 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:39 smithi052 ceph-mon[34308]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:40.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 -- 172.21.15.29:0/515212457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c105320 msgr2=0x7f6a0c10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:40.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 --2- 172.21.15.29:0/515212457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c105320 0x7f6a0c10d870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009900 tx=0x7f6a0002a410 comp rx=0 tx=0).stop 2024-09-21T07:07:40.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 -- 172.21.15.29:0/515212457 shutdown_connections 2024-09-21T07:07:40.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 --2- 172.21.15.29:0/515212457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a0c10de30 0x7f6a0c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 --2- 172.21.15.29:0/515212457 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c105320 0x7f6a0c10d870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 --2- 172.21.15.29:0/515212457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0c1049d0 0x7f6a0c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 -- 172.21.15.29:0/515212457 >> 172.21.15.29:0/515212457 conn(0x7f6a0c079740 msgr2=0x7f6a0c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:40.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 -- 172.21.15.29:0/515212457 shutdown_connections 2024-09-21T07:07:40.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.045+0000 7f6a109f7640 1 -- 172.21.15.29:0/515212457 wait complete. 2024-09-21T07:07:40.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 Processor -- start 2024-09-21T07:07:40.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 -- start start 2024-09-21T07:07:40.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c1049d0 0x7f6a0c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a0c105320 0x7f6a0c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0c10de30 0x7f6a0c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c113a90 con 0x7f6a0c1049d0 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c113910 con 0x7f6a0c10de30 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a109f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c113c10 con 0x7f6a0c105320 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.046+0000 7f6a0a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c1049d0 0x7f6a0c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c1049d0 0x7f6a0c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57888/0 (socket says 172.21.15.29:57888) 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 -- 172.21.15.29:0/555599466 learned_addr learned my addr 172.21.15.29:0/555599466 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0ad9d640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0c10de30 0x7f6a0c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a09d9b640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a0c105320 0x7f6a0c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 -- 172.21.15.29:0/555599466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a0c105320 msgr2=0x7f6a0c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:40.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a0c105320 0x7f6a0c19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 -- 172.21.15.29:0/555599466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0c10de30 msgr2=0x7f6a0c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0c10de30 0x7f6a0c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 -- 172.21.15.29:0/555599466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c1a0430 con 0x7f6a0c1049d0 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a0a59c640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c1049d0 0x7f6a0c19a4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9c0 tx=0x7f69fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f69fb7fe640 1 -- 172.21.15.29:0/555599466 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00cd80 con 0x7f6a0c1049d0 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f69fb7fe640 1 -- 172.21.15.29:0/555599466 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69fc0035f0 con 0x7f6a0c1049d0 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c1a0720 con 0x7f6a0c1049d0 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f69fb7fe640 1 -- 172.21.15.29:0/555599466 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc010690 con 0x7f6a0c1049d0 2024-09-21T07:07:40.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.047+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c1a6e80 con 0x7f6a0c1049d0 2024-09-21T07:07:40.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.049+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c06c240 con 0x7f6a0c1049d0 2024-09-21T07:07:40.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.050+0000 7f69fb7fe640 1 -- 172.21.15.29:0/555599466 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f69fc0037a0 con 0x7f6a0c1049d0 2024-09-21T07:07:40.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.051+0000 7f69fb7fe640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f69f40b6590 0x7f69f40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:40.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.051+0000 7f6a09d9b640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f69f40b6590 0x7f69f40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:40.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.052+0000 7f69fb7fe640 1 -- 172.21.15.29:0/555599466 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f69fc0e74d0 con 0x7f6a0c1049d0 2024-09-21T07:07:40.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.052+0000 7f6a09d9b640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f69f40b6590 0x7f69f40b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009230 tx=0x7f6a00031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:40.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.056+0000 7f69fb7fe640 1 -- 172.21.15.29:0/555599466 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69fc0adeb0 con 0x7f6a0c1049d0 2024-09-21T07:07:40.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.283+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f6a0c02e640 con 0x7f6a0c1049d0 2024-09-21T07:07:40.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.588+0000 7f69fb7fe640 1 -- 172.21.15.29:0/555599466 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f69fc0b2290 con 0x7f6a0c1049d0 2024-09-21T07:07:40.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f69f40b6590 msgr2=0x7f69f40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:40.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f69f40b6590 0x7f69f40b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009230 tx=0x7f6a00031400 comp rx=0 tx=0).stop 2024-09-21T07:07:40.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c1049d0 msgr2=0x7f6a0c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c1049d0 0x7f6a0c19a4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e9c0 tx=0x7f69fc00ee80 comp rx=0 tx=0).stop 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 shutdown_connections 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f69f40b6590 0x7f69f40b8aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a0c10de30 0x7f6a0c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a0c105320 0x7f6a0c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 --2- 172.21.15.29:0/555599466 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a0c1049d0 0x7f6a0c19a4c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 >> 172.21.15.29:0/555599466 conn(0x7f6a0c079740 msgr2=0x7f6a0c1008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 shutdown_connections 2024-09-21T07:07:40.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:40.591+0000 7f6a109f7640 1 -- 172.21.15.29:0/555599466 wait complete. 2024-09-21T07:07:40.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:40 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/555599466' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:07:40.864 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:40 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/555599466' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:07:40.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:40 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/555599466' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T07:07:41.346 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T07:07:41.628 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:41 smithi066 ceph-mon[34793]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:07:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:41 smithi066 ceph-mon[34793]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:07:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:41 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/555599466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:07:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:41 smithi066 ceph-mon[34793]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:07:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:41 smithi066 ceph-mon[34793]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:41.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:41 smithi066 ceph-mon[34793]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T07:07:41.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:41 smithi066 ceph-mon[34793]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T07:07:41.862 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:41 smithi029 ceph-mon[30983]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:07:41.863 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:41 smithi029 ceph-mon[30983]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:07:41.863 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:41 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/555599466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:07:41.863 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:41 smithi029 ceph-mon[30983]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:07:41.863 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:41 smithi029 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:41.863 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:41 smithi029 ceph-mon[30983]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T07:07:41.863 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:41 smithi029 ceph-mon[30983]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T07:07:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:41 smithi052 ceph-mon[34308]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T07:07:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:41 smithi052 ceph-mon[34308]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T07:07:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:41 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/555599466' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T07:07:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:41 smithi052 ceph-mon[34308]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T07:07:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:41 smithi052 ceph-mon[34308]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T07:07:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:41 smithi052 ceph-mon[34308]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T07:07:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:41 smithi052 ceph-mon[34308]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 -- 172.21.15.29:0/3153178334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74109e20 msgr2=0x7f7b74110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3153178334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74109e20 0x7f7b74110650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009ca0 tx=0x7f7b6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 -- 172.21.15.29:0/3153178334 shutdown_connections 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3153178334 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74109e20 0x7f7b74110650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3153178334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b741094d0 0x7f7b741098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3153178334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b74103b90 0x7f7b74103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 -- 172.21.15.29:0/3153178334 >> 172.21.15.29:0/3153178334 conn(0x7f7b740ff600 msgr2=0x7f7b74101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 -- 172.21.15.29:0/3153178334 shutdown_connections 2024-09-21T07:07:42.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.063+0000 7f7b7b135640 1 -- 172.21.15.29:0/3153178334 wait complete. 2024-09-21T07:07:42.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 Processor -- start 2024-09-21T07:07:42.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 -- start start 2024-09-21T07:07:42.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74103b90 0x7f7b7419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b741094d0 0x7f7b7419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b74109e20 0x7f7b7419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74113ae0 con 0x7f7b74103b90 2024-09-21T07:07:42.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74113960 con 0x7f7b741094d0 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b7b135640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7b74113c60 con 0x7f7b74109e20 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b78ed1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74103b90 0x7f7b7419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b78ed1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74103b90 0x7f7b7419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57908/0 (socket says 172.21.15.29:57908) 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b78ed1640 1 -- 172.21.15.29:0/3167075604 learned_addr learned my addr 172.21.15.29:0/3167075604 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b73fff640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b741094d0 0x7f7b7419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b78ed1640 1 -- 172.21.15.29:0/3167075604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b74109e20 msgr2=0x7f7b7419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.064+0000 7f7b796d2640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b74109e20 0x7f7b7419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b78ed1640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b74109e20 0x7f7b7419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b78ed1640 1 -- 172.21.15.29:0/3167075604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b741094d0 msgr2=0x7f7b7419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b78ed1640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b741094d0 0x7f7b7419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b78ed1640 1 -- 172.21.15.29:0/3167075604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b741a02e0 con 0x7f7b74103b90 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b73fff640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b741094d0 0x7f7b7419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:07:42.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b78ed1640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74103b90 0x7f7b7419a430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c920 tx=0x7f7b6000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:42.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b71ffb640 1 -- 172.21.15.29:0/3167075604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60007c70 con 0x7f7b74103b90 2024-09-21T07:07:42.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b71ffb640 1 -- 172.21.15.29:0/3167075604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b60007e10 con 0x7f7b74103b90 2024-09-21T07:07:42.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b741a05d0 con 0x7f7b74103b90 2024-09-21T07:07:42.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b71ffb640 1 -- 172.21.15.29:0/3167075604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60018820 con 0x7f7b74103b90 2024-09-21T07:07:42.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.065+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b741a6df0 con 0x7f7b74103b90 2024-09-21T07:07:42.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.066+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b74103fa0 con 0x7f7b74103b90 2024-09-21T07:07:42.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.068+0000 7f7b71ffb640 1 -- 172.21.15.29:0/3167075604 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f7b6000f450 con 0x7f7b74103b90 2024-09-21T07:07:42.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.068+0000 7f7b71ffb640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7b640b65c0 0x7f7b640b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:42.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.069+0000 7f7b73fff640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7b640b65c0 0x7f7b640b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:42.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.069+0000 7f7b71ffb640 1 -- 172.21.15.29:0/3167075604 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f7b600e7570 con 0x7f7b74103b90 2024-09-21T07:07:42.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.069+0000 7f7b73fff640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7b640b65c0 0x7f7b640b8ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b74102d00 tx=0x7f7b68005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:42.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.072+0000 7f7b71ffb640 1 -- 172.21.15.29:0/3167075604 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b60014030 con 0x7f7b74103b90 2024-09-21T07:07:42.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.303+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f7b7419b560 con 0x7f7b74103b90 2024-09-21T07:07:42.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.605+0000 7f7b71ffb640 1 -- 172.21.15.29:0/3167075604 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f7b600ae060 con 0x7f7b74103b90 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7b640b65c0 msgr2=0x7f7b640b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7b640b65c0 0x7f7b640b8ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7b74102d00 tx=0x7f7b68005d30 comp rx=0 tx=0).stop 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74103b90 msgr2=0x7f7b7419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74103b90 0x7f7b7419a430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c920 tx=0x7f7b6000cde0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 shutdown_connections 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7b640b65c0 0x7f7b640b8ad0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b74109e20 0x7f7b7419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b741094d0 0x7f7b7419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 --2- 172.21.15.29:0/3167075604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b74103b90 0x7f7b7419a430 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 >> 172.21.15.29:0/3167075604 conn(0x7f7b740ff600 msgr2=0x7f7b74108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:42.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 shutdown_connections 2024-09-21T07:07:42.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:42.608+0000 7f7b7b135640 1 -- 172.21.15.29:0/3167075604 wait complete. 2024-09-21T07:07:42.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:42 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] up:active 2024-09-21T07:07:42.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:42 smithi066 ceph-mon[34793]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:07:42.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:42 smithi066 ceph-mon[34793]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T07:07:42.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:42 smithi066 ceph-mon[34793]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T07:07:42.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:42 smithi066 ceph-mon[34793]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T07:07:42.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:42 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3167075604' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:07:42.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:42 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] up:active 2024-09-21T07:07:42.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:42 smithi029 ceph-mon[30983]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:07:42.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:42 smithi029 ceph-mon[30983]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T07:07:42.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:42 smithi029 ceph-mon[30983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T07:07:42.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:42 smithi029 ceph-mon[30983]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T07:07:42.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:42 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3167075604' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:07:42.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:42 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] up:active 2024-09-21T07:07:42.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:42 smithi052 ceph-mon[34308]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T07:07:42.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:42 smithi052 ceph-mon[34308]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T07:07:42.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:42 smithi052 ceph-mon[34308]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T07:07:42.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:42 smithi052 ceph-mon[34308]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T07:07:42.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:42 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3167075604' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T07:07:43.309 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T07:07:43.573 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:43 smithi029 ceph-mon[30983]: pgmap v296: 97 pgs: 97 active+clean; 580 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-21T07:07:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:43 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3167075604' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:07:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:43 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] up:active 2024-09-21T07:07:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:43 smithi029 ceph-mon[30983]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:07:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:43 smithi029 ceph-mon[30983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T07:07:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:43 smithi029 ceph-mon[30983]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T07:07:43.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:43 smithi029 ceph-mon[30983]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T07:07:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:43 smithi052 ceph-mon[34308]: pgmap v296: 97 pgs: 97 active+clean; 580 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-21T07:07:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:43 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3167075604' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:07:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:43 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] up:active 2024-09-21T07:07:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:43 smithi052 ceph-mon[34308]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:07:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:43 smithi052 ceph-mon[34308]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T07:07:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:43 smithi052 ceph-mon[34308]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T07:07:43.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:43 smithi052 ceph-mon[34308]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T07:07:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:43 smithi066 ceph-mon[34793]: pgmap v296: 97 pgs: 97 active+clean; 580 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-21T07:07:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:43 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3167075604' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T07:07:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:43 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] up:active 2024-09-21T07:07:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:43 smithi066 ceph-mon[34793]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T07:07:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:43 smithi066 ceph-mon[34793]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T07:07:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:43 smithi066 ceph-mon[34793]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T07:07:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:43 smithi066 ceph-mon[34793]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T07:07:44.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.150+0000 7fae65a14640 1 -- 172.21.15.29:0/787246959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae601083b0 msgr2=0x7fae601087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:44.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.150+0000 7fae65a14640 1 --2- 172.21.15.29:0/787246959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae601083b0 0x7fae601087c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae54009900 tx=0x7fae5402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:44.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 -- 172.21.15.29:0/787246959 shutdown_connections 2024-09-21T07:07:44.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 --2- 172.21.15.29:0/787246959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae60108d00 0x7fae6010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 --2- 172.21.15.29:0/787246959 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae601083b0 0x7fae601087c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 --2- 172.21.15.29:0/787246959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae60102ac0 0x7fae60102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 -- 172.21.15.29:0/787246959 >> 172.21.15.29:0/787246959 conn(0x7fae60079790 msgr2=0x7fae60079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:44.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 -- 172.21.15.29:0/787246959 shutdown_connections 2024-09-21T07:07:44.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 -- 172.21.15.29:0/787246959 wait complete. 2024-09-21T07:07:44.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.151+0000 7fae65a14640 1 Processor -- start 2024-09-21T07:07:44.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae65a14640 1 -- start start 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae65a14640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae60102ac0 0x7fae6019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae65a14640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae601083b0 0x7fae6019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae65a14640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae60108d00 0x7fae6019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae65a14640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fae60113ae0 con 0x7fae60102ac0 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae65a14640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fae60113960 con 0x7fae601083b0 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae65a14640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae60113c60 con 0x7fae60108d00 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae5effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae60102ac0 0x7fae6019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae5effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae60102ac0 0x7fae6019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57924/0 (socket says 172.21.15.29:57924) 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae5effd640 1 -- 172.21.15.29:0/1172959636 learned_addr learned my addr 172.21.15.29:0/1172959636 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae5e7fc640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae601083b0 0x7fae6019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:44.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.152+0000 7fae5f7fe640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae60108d00 0x7fae6019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae5effd640 1 -- 172.21.15.29:0/1172959636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae60108d00 msgr2=0x7fae6019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae5effd640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae60108d00 0x7fae6019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae5effd640 1 -- 172.21.15.29:0/1172959636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae601083b0 msgr2=0x7fae6019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae5effd640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae601083b0 0x7fae6019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae5effd640 1 -- 172.21.15.29:0/1172959636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae601a0400 con 0x7fae60102ac0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae5effd640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae60102ac0 0x7fae6019a490 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae5000d950 tx=0x7fae5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae64a12640 1 -- 172.21.15.29:0/1172959636 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50017070 con 0x7fae60102ac0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae64a12640 1 -- 172.21.15.29:0/1172959636 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae50009c30 con 0x7fae60102ac0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae601a06f0 con 0x7fae60102ac0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae64a12640 1 -- 172.21.15.29:0/1172959636 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5000f620 con 0x7fae60102ac0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.153+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6010fef0 con 0x7fae60102ac0 2024-09-21T07:07:44.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.154+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae60102ed0 con 0x7fae60102ac0 2024-09-21T07:07:44.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.157+0000 7fae64a12640 1 -- 172.21.15.29:0/1172959636 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fae50010460 con 0x7fae60102ac0 2024-09-21T07:07:44.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.157+0000 7fae64a12640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fae480b6510 0x7fae480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:44.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.158+0000 7fae5e7fc640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fae480b6510 0x7fae480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:44.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.158+0000 7fae64a12640 1 -- 172.21.15.29:0/1172959636 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fae500e6d20 con 0x7fae60102ac0 2024-09-21T07:07:44.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.158+0000 7fae5e7fc640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fae480b6510 0x7fae480b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae54009230 tx=0x7fae54031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:44.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.161+0000 7fae64a12640 1 -- 172.21.15.29:0/1172959636 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae50009de0 con 0x7fae60102ac0 2024-09-21T07:07:44.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.388+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fae6019b5c0 con 0x7fae60102ac0 2024-09-21T07:07:44.615 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: 2024-09-21T07:07:44.287+0000 7fd745ad5640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T07:07:44.616 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: 2024-09-21T07:07:44.287+0000 7fd745ad5640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T07:07:44.616 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: 2024-09-21T07:07:44.287+0000 7fd745ad5640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-21T07:07:44.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.622+0000 7fae64a12640 1 -- 172.21.15.29:0/1172959636 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fae500b1ae0 con 0x7fae60102ac0 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fae480b6510 msgr2=0x7fae480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fae480b6510 0x7fae480b8a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fae54009230 tx=0x7fae54031400 comp rx=0 tx=0).stop 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae60102ac0 msgr2=0x7fae6019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae60102ac0 0x7fae6019a490 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae5000d950 tx=0x7fae5000de10 comp rx=0 tx=0).stop 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 shutdown_connections 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fae480b6510 0x7fae480b8a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae60108d00 0x7fae6019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae601083b0 0x7fae6019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 --2- 172.21.15.29:0/1172959636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae60102ac0 0x7fae6019a490 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:44.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 >> 172.21.15.29:0/1172959636 conn(0x7fae60079790 msgr2=0x7fae601064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:44.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 shutdown_connections 2024-09-21T07:07:44.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:44.624+0000 7fae65a14640 1 -- 172.21.15.29:0/1172959636 wait complete. 2024-09-21T07:07:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] up:active 2024-09-21T07:07:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:07:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:07:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: Cluster is now healthy 2024-09-21T07:07:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T07:07:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:07:44.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-09-21T07:07:44.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:44 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1172959636' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:07:44.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] up:active 2024-09-21T07:07:44.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:07:44.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:07:44.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: Cluster is now healthy 2024-09-21T07:07:44.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T07:07:44.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:07:44.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-09-21T07:07:44.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:44 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1172959636' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:07:45.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] up:active 2024-09-21T07:07:45.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T07:07:45.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T07:07:45.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: Cluster is now healthy 2024-09-21T07:07:45.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T07:07:45.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T07:07:45.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: daemon mds.e is now active in filesystem cephfs as rank 4 2024-09-21T07:07:45.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:44 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1172959636' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T07:07:45.317 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T07:07:45.317 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T07:07:45.579 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:45.928 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:45 smithi029 ceph-mon[30983]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 10 op/s 2024-09-21T07:07:45.928 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:45 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1172959636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:07:45.928 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:45 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] up:active 2024-09-21T07:07:45.928 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:45 smithi029 ceph-mon[30983]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:07:45.928 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:45 smithi029 ceph-mon[30983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:07:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:45 smithi052 ceph-mon[34308]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 10 op/s 2024-09-21T07:07:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:45 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1172959636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:07:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:45 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] up:active 2024-09-21T07:07:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:45 smithi052 ceph-mon[34308]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:07:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:45 smithi052 ceph-mon[34308]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:07:46.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:45 smithi066 ceph-mon[34793]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s wr, 10 op/s 2024-09-21T07:07:46.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:45 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1172959636' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T07:07:46.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:45 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] up:active 2024-09-21T07:07:46.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:45 smithi066 ceph-mon[34793]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T07:07:46.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:45 smithi066 ceph-mon[34793]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:07:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 -- 172.21.15.29:0/3778074899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 msgr2=0x7ff6ac10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/3778074899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac10f560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009ca0 tx=0x7ff6a402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 -- 172.21.15.29:0/3778074899 shutdown_connections 2024-09-21T07:07:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/3778074899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac10f560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/3778074899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6ac1083e0 0x7ff6ac1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/3778074899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6ac102aa0 0x7ff6ac102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 -- 172.21.15.29:0/3778074899 >> 172.21.15.29:0/3778074899 conn(0x7ff6ac079750 msgr2=0x7ff6ac079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 -- 172.21.15.29:0/3778074899 shutdown_connections 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.147+0000 7ff6b0d80640 1 -- 172.21.15.29:0/3778074899 wait complete. 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.148+0000 7ff6b0d80640 1 Processor -- start 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.148+0000 7ff6b0d80640 1 -- start start 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6b0d80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6ac102aa0 0x7ff6ac19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6b0d80640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6ac1083e0 0x7ff6ac19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6b0d80640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6b0d80640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac1129f0 con 0x7ff6ac108d30 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6b0d80640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac112870 con 0x7ff6ac1083e0 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6b0d80640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac112b70 con 0x7ff6ac102aa0 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:46.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:57928/0 (socket says 172.21.15.29:57928) 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 -- 172.21.15.29:0/100127206 learned_addr learned my addr 172.21.15.29:0/100127206 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aa59c640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6ac102aa0 0x7ff6ac19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6a1d9b640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6ac1083e0 0x7ff6ac19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 -- 172.21.15.29:0/100127206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6ac102aa0 msgr2=0x7ff6ac19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6ac102aa0 0x7ff6ac19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 -- 172.21.15.29:0/100127206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6ac1083e0 msgr2=0x7ff6ac19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6ac1083e0 0x7ff6ac19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.149+0000 7ff6aad9d640 1 -- 172.21.15.29:0/100127206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac1a0420 con 0x7ff6ac108d30 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.150+0000 7ff6aad9d640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac19fdb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005cc0 tx=0x7ff6a402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.150+0000 7ff6a3fff640 1 -- 172.21.15.29:0/100127206 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4003cf0 con 0x7ff6ac108d30 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.150+0000 7ff6a3fff640 1 -- 172.21.15.29:0/100127206 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6a40044f0 con 0x7ff6ac108d30 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.150+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac1a06b0 con 0x7ff6ac108d30 2024-09-21T07:07:46.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.150+0000 7ff6a3fff640 1 -- 172.21.15.29:0/100127206 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a402fc30 con 0x7ff6ac108d30 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.150+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac1a0bf0 con 0x7ff6ac108d30 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.151+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac102eb0 con 0x7ff6ac108d30 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.153+0000 7ff6a3fff640 1 -- 172.21.15.29:0/100127206 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7ff6a40046a0 con 0x7ff6ac108d30 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.153+0000 7ff6a3fff640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff6980b6540 0x7ff6980b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.154+0000 7ff6aa59c640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff6980b6540 0x7ff6980b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.154+0000 7ff6a3fff640 1 -- 172.21.15.29:0/100127206 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7ff6a4108730 con 0x7ff6ac108d30 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.154+0000 7ff6aa59c640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff6980b6540 0x7ff6980b8a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00abe0 tx=0x7ff69c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:46.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.157+0000 7ff6a3fff640 1 -- 172.21.15.29:0/100127206 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6a40cf110 con 0x7ff6ac108d30 2024-09-21T07:07:46.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.375+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff6ac1061d0 con 0x7ff6980b6540 2024-09-21T07:07:46.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.409+0000 7ff6a3fff640 1 -- 172.21.15.29:0/100127206 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff6ac1061d0 con 0x7ff6980b6540 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff6980b6540 msgr2=0x7ff6980b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff6980b6540 0x7ff6980b8a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00abe0 tx=0x7ff69c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 msgr2=0x7ff6ac19fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac19fdb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4005cc0 tx=0x7ff6a402f470 comp rx=0 tx=0).stop 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 shutdown_connections 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff6980b6540 0x7ff6980b8a50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6ac108d30 0x7ff6ac19fdb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6ac1083e0 0x7ff6ac19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 --2- 172.21.15.29:0/100127206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6ac102aa0 0x7ff6ac19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 >> 172.21.15.29:0/100127206 conn(0x7ff6ac079750 msgr2=0x7ff6ac101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 shutdown_connections 2024-09-21T07:07:46.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:46.412+0000 7ff6b0d80640 1 -- 172.21.15.29:0/100127206 wait complete. 2024-09-21T07:07:46.729 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:07:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T07:07:46.380+0000 7f347f634640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:07:46.729 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:07:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T07:07:46.380+0000 7f347f634640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:07:46.729 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:07:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T07:07:46.380+0000 7f347f634640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:07:46.729 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:07:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T07:07:46.380+0000 7f347f634640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:07:46.729 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:07:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T07:07:46.380+0000 7f347f634640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T07:07:47.082 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T07:07:47.343 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:47.735 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:47 smithi029 ceph-mon[30983]: pgmap v298: 97 pgs: 97 active+clean; 583 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-09-21T07:07:47.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:47 smithi029 ceph-mon[30983]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 -- 172.21.15.29:0/2822328293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0108420 msgr2=0x7fadf0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 --2- 172.21.15.29:0/2822328293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0108420 0x7fadf0108830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fade4009900 tx=0x7fade402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 -- 172.21.15.29:0/2822328293 shutdown_connections 2024-09-21T07:07:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 --2- 172.21.15.29:0/2822328293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf0108d70 0x7fadf010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 --2- 172.21.15.29:0/2822328293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0108420 0x7fadf0108830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 --2- 172.21.15.29:0/2822328293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf0102ae0 0x7fadf0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:47.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 -- 172.21.15.29:0/2822328293 >> 172.21.15.29:0/2822328293 conn(0x7fadf0079770 msgr2=0x7fadf0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:47.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 -- 172.21.15.29:0/2822328293 shutdown_connections 2024-09-21T07:07:47.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.830+0000 7fadf55a7640 1 -- 172.21.15.29:0/2822328293 wait complete. 2024-09-21T07:07:47.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.831+0000 7fadf55a7640 1 Processor -- start 2024-09-21T07:07:47.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.831+0000 7fadf55a7640 1 -- start start 2024-09-21T07:07:47.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadf55a7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0102ae0 0x7fadf019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadf55a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf0108420 0x7fadf019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadf55a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf0108d70 0x7fadf019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadf55a7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fadf0112a30 con 0x7fadf0102ae0 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadf55a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadf01128b0 con 0x7fadf0108420 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadf55a7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fadf0112bb0 con 0x7fadf0108d70 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0102ae0 0x7fadf019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0102ae0 0x7fadf019b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39512/0 (socket says 172.21.15.29:39512) 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 -- 172.21.15.29:0/4092260252 learned_addr learned my addr 172.21.15.29:0/4092260252 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadef7fe640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf0108d70 0x7fadf019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadee7fc640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf0108420 0x7fadf019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 -- 172.21.15.29:0/4092260252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf0108d70 msgr2=0x7fadf019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf0108d70 0x7fadf019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:47.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 -- 172.21.15.29:0/4092260252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf0108420 msgr2=0x7fadf019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf0108420 0x7fadf019b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 -- 172.21.15.29:0/4092260252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf01a65a0 con 0x7fadf0102ae0 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.832+0000 7fadeeffd640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0102ae0 0x7fadf019b3a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fade000c920 tx=0x7fade000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.833+0000 7fadd7fff640 1 -- 172.21.15.29:0/4092260252 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0007c70 con 0x7fadf0102ae0 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.833+0000 7fadd7fff640 1 -- 172.21.15.29:0/4092260252 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade0007e10 con 0x7fadf0102ae0 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.833+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf01a6890 con 0x7fadf0102ae0 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.833+0000 7fadd7fff640 1 -- 172.21.15.29:0/4092260252 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0018820 con 0x7fadf0102ae0 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.833+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf01a6dd0 con 0x7fadf0102ae0 2024-09-21T07:07:47.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.834+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf0103d60 con 0x7fadf0102ae0 2024-09-21T07:07:47.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.835+0000 7fadd7fff640 1 -- 172.21.15.29:0/4092260252 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fade000f450 con 0x7fadf0102ae0 2024-09-21T07:07:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.836+0000 7fadd7fff640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fadd80b6540 0x7fadd80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.837+0000 7fadee7fc640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fadd80b6540 0x7fadd80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.837+0000 7fadd7fff640 1 -- 172.21.15.29:0/4092260252 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fade00e7610 con 0x7fadf0102ae0 2024-09-21T07:07:47.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.837+0000 7fadee7fc640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fadd80b6540 0x7fadd80b8a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fade4006010 tx=0x7fade4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:47.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:47.840+0000 7fadd7fff640 1 -- 172.21.15.29:0/4092260252 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fade0014030 con 0x7fadf0102ae0 2024-09-21T07:07:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:47 smithi052 ceph-mon[34308]: pgmap v298: 97 pgs: 97 active+clean; 583 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-09-21T07:07:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:47 smithi052 ceph-mon[34308]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:48.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.053+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fadf0063800 con 0x7fadd80b6540 2024-09-21T07:07:48.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.083+0000 7fadd7fff640 1 -- 172.21.15.29:0/4092260252 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fadf0063800 con 0x7fadd80b6540 2024-09-21T07:07:48.238 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:47 smithi066 ceph-mon[34793]: pgmap v298: 97 pgs: 97 active+clean; 583 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-09-21T07:07:48.238 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:47 smithi066 ceph-mon[34793]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:48.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fadd80b6540 msgr2=0x7fadd80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:48.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fadd80b6540 0x7fadd80b8a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fade4006010 tx=0x7fade4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0102ae0 msgr2=0x7fadf019b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0102ae0 0x7fadf019b3a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fade000c920 tx=0x7fade000cde0 comp rx=0 tx=0).stop 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 shutdown_connections 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fadd80b6540 0x7fadd80b8a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadf0108d70 0x7fadf019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf0108420 0x7fadf019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 --2- 172.21.15.29:0/4092260252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadf0102ae0 0x7fadf019b3a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 >> 172.21.15.29:0/4092260252 conn(0x7fadf0079770 msgr2=0x7fadf0106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 shutdown_connections 2024-09-21T07:07:48.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:48.085+0000 7fadf55a7640 1 -- 172.21.15.29:0/4092260252 wait complete. 2024-09-21T07:07:48.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T07:07:49.030 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.543+0000 7fa643223640 1 -- 172.21.15.29:0/1633137774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 msgr2=0x7fa63c110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.543+0000 7fa643223640 1 --2- 172.21.15.29:0/1633137774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c110310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa634009ca0 tx=0x7fa63402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.543+0000 7fa643223640 1 -- 172.21.15.29:0/1633137774 shutdown_connections 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.543+0000 7fa643223640 1 --2- 172.21.15.29:0/1633137774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c110310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.543+0000 7fa643223640 1 --2- 172.21.15.29:0/1633137774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c105280 0x7fa63c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.543+0000 7fa643223640 1 --2- 172.21.15.29:0/1633137774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa63c104850 0x7fa63c104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.543+0000 7fa643223640 1 -- 172.21.15.29:0/1633137774 >> 172.21.15.29:0/1633137774 conn(0x7fa63c079710 msgr2=0x7fa63c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.544+0000 7fa643223640 1 -- 172.21.15.29:0/1633137774 shutdown_connections 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.544+0000 7fa643223640 1 -- 172.21.15.29:0/1633137774 wait complete. 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.544+0000 7fa643223640 1 Processor -- start 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.544+0000 7fa643223640 1 -- start start 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa643223640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c104850 0x7fa63c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa643223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa63c105280 0x7fa63c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa643223640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa643223640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c113aa0 con 0x7fa63c10de00 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa643223640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c113920 con 0x7fa63c104850 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa643223640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c113c20 con 0x7fa63c105280 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39518/0 (socket says 172.21.15.29:39518) 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 -- 172.21.15.29:0/3669401530 learned_addr learned my addr 172.21.15.29:0/3669401530 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa63bfff640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa63c105280 0x7fa63c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa640fbf640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c104850 0x7fa63c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 -- 172.21.15.29:0/3669401530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa63c105280 msgr2=0x7fa63c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa63c105280 0x7fa63c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 -- 172.21.15.29:0/3669401530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c104850 msgr2=0x7fa63c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c104850 0x7fa63c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 -- 172.21.15.29:0/3669401530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c1a0440 con 0x7fa63c10de00 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.545+0000 7fa6417c0640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c19fd10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa634005cc0 tx=0x7fa63402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.546+0000 7fa639ffb640 1 -- 172.21.15.29:0/3669401530 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634003bf0 con 0x7fa63c10de00 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.546+0000 7fa639ffb640 1 -- 172.21.15.29:0/3669401530 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa634003d90 con 0x7fa63c10de00 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.546+0000 7fa639ffb640 1 -- 172.21.15.29:0/3669401530 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63402fbc0 con 0x7fa63c10de00 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.546+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63c1a06d0 con 0x7fa63c10de00 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.546+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63c1a6e90 con 0x7fa63c10de00 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.547+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63c06c220 con 0x7fa63c10de00 2024-09-21T07:07:49.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.549+0000 7fa639ffb640 1 -- 172.21.15.29:0/3669401530 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa63402fd60 con 0x7fa63c10de00 2024-09-21T07:07:49.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.549+0000 7fa639ffb640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa6280b65a0 0x7fa6280b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:49.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.550+0000 7fa640fbf640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa6280b65a0 0x7fa6280b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:49.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.550+0000 7fa639ffb640 1 -- 172.21.15.29:0/3669401530 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa6341088d0 con 0x7fa63c10de00 2024-09-21T07:07:49.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.550+0000 7fa640fbf640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa6280b65a0 0x7fa6280b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa624005fd0 tx=0x7fa62400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:49.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.553+0000 7fa639ffb640 1 -- 172.21.15.29:0/3669401530 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6340cf1b0 con 0x7fa63c10de00 2024-09-21T07:07:49.635 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:07:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: 2024-09-21T07:07:49.287+0000 7fd745ad5640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-21T07:07:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.771+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fa63c107050 con 0x7fa6280b65a0 2024-09-21T07:07:49.773 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:49 smithi029 ceph-mon[30983]: pgmap v299: 97 pgs: 97 active+clean; 585 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-21T07:07:49.773 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:49 smithi029 ceph-mon[30983]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:49.773 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:49 smithi029 ceph-mon[30983]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:07:49.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.778+0000 7fa639ffb640 1 -- 172.21.15.29:0/3669401530 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa63c107050 con 0x7fa6280b65a0 2024-09-21T07:07:49.780 INFO:teuthology.orchestra.run.smithi029.stdout:/volumes/qa/sv_0/14eb3c0f-4479-4905-87ac-d0ed28969453 2024-09-21T07:07:49.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa6280b65a0 msgr2=0x7fa6280b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa6280b65a0 0x7fa6280b8ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa624005fd0 tx=0x7fa62400b390 comp rx=0 tx=0).stop 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 msgr2=0x7fa63c19fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c19fd10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa634005cc0 tx=0x7fa63402f380 comp rx=0 tx=0).stop 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 shutdown_connections 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa6280b65a0 0x7fa6280b8ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa63c10de00 0x7fa63c19fd10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa63c105280 0x7fa63c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 --2- 172.21.15.29:0/3669401530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa63c104850 0x7fa63c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 >> 172.21.15.29:0/3669401530 conn(0x7fa63c079710 msgr2=0x7fa63c106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 shutdown_connections 2024-09-21T07:07:49.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:49.781+0000 7fa643223640 1 -- 172.21.15.29:0/3669401530 wait complete. 2024-09-21T07:07:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:49 smithi052 ceph-mon[34308]: pgmap v299: 97 pgs: 97 active+clean; 585 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-21T07:07:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:49 smithi052 ceph-mon[34308]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:49 smithi052 ceph-mon[34308]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:07:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:49 smithi066 ceph-mon[34793]: pgmap v299: 97 pgs: 97 active+clean; 585 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-21T07:07:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:49 smithi066 ceph-mon[34793]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:49 smithi066 ceph-mon[34793]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-21T07:07:50.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T07:07:50.791 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 -- 172.21.15.29:0/2291014319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc109df0 msgr2=0x7f06dc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 --2- 172.21.15.29:0/2291014319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc109df0 0x7f06dc110620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009900 tx=0x7f06d402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 -- 172.21.15.29:0/2291014319 shutdown_connections 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 --2- 172.21.15.29:0/2291014319 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc109df0 0x7f06dc110620 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 --2- 172.21.15.29:0/2291014319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06dc1094a0 0x7f06dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 --2- 172.21.15.29:0/2291014319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06dc103b60 0x7f06dc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 -- 172.21.15.29:0/2291014319 >> 172.21.15.29:0/2291014319 conn(0x7f06dc07b850 msgr2=0x7f06dc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 -- 172.21.15.29:0/2291014319 shutdown_connections 2024-09-21T07:07:51.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.255+0000 7f06e0e76640 1 -- 172.21.15.29:0/2291014319 wait complete. 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 Processor -- start 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 -- start start 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06dc103b60 0x7f06dc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc1094a0 0x7f06dc19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06dc109df0 0x7f06dc19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc113ab0 con 0x7f06dc1094a0 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc113930 con 0x7f06dc103b60 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06e0e76640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc113c30 con 0x7f06dc109df0 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc1094a0 0x7f06dc19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc1094a0 0x7f06dc19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39528/0 (socket says 172.21.15.29:39528) 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 -- 172.21.15.29:0/3025264942 learned_addr learned my addr 172.21.15.29:0/3025264942 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06da59c640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06dc103b60 0x7f06dc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06dad9d640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06dc109df0 0x7f06dc19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:51.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 -- 172.21.15.29:0/3025264942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06dc109df0 msgr2=0x7f06dc19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06dc109df0 0x7f06dc19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 -- 172.21.15.29:0/3025264942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06dc103b60 msgr2=0x7f06dc19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06dc103b60 0x7f06dc19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06d9d9b640 1 -- 172.21.15.29:0/3025264942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc1a0310 con 0x7f06dc1094a0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06da59c640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06dc103b60 0x7f06dc19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.256+0000 7f06dad9d640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06dc109df0 0x7f06dc19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.257+0000 7f06d9d9b640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc1094a0 0x7f06dc19aa00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06d000e9c0 tx=0x7f06d000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.257+0000 7f06cb7fe640 1 -- 172.21.15.29:0/3025264942 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d000ccc0 con 0x7f06dc1094a0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.257+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc1a0600 con 0x7f06dc1094a0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.257+0000 7f06cb7fe640 1 -- 172.21.15.29:0/3025264942 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06d00054d0 con 0x7f06dc1094a0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.257+0000 7f06cb7fe640 1 -- 172.21.15.29:0/3025264942 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0010430 con 0x7f06dc1094a0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.257+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc1a6e20 con 0x7f06dc1094a0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.258+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc103f70 con 0x7f06dc1094a0 2024-09-21T07:07:51.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.259+0000 7f06cb7fe640 1 -- 172.21.15.29:0/3025264942 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f06d0005020 con 0x7f06dc1094a0 2024-09-21T07:07:51.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.260+0000 7f06cb7fe640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f06c40b65d0 0x7f06c40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:51.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.260+0000 7f06da59c640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f06c40b65d0 0x7f06c40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:51.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.260+0000 7f06cb7fe640 1 -- 172.21.15.29:0/3025264942 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f06d00e7770 con 0x7f06dc1094a0 2024-09-21T07:07:51.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.261+0000 7f06da59c640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f06c40b65d0 0x7f06c40b8ae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f06cc007e70 tx=0x7f06cc007850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:51.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.264+0000 7f06cb7fe640 1 -- 172.21.15.29:0/3025264942 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06d00ae050 con 0x7f06dc1094a0 2024-09-21T07:07:51.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.481+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f06dc063800 con 0x7f06c40b65d0 2024-09-21T07:07:51.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.509+0000 7f06cb7fe640 1 -- 172.21.15.29:0/3025264942 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f06dc063800 con 0x7f06c40b65d0 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f06c40b65d0 msgr2=0x7f06c40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f06c40b65d0 0x7f06c40b8ae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f06cc007e70 tx=0x7f06cc007850 comp rx=0 tx=0).stop 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc1094a0 msgr2=0x7f06dc19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc1094a0 0x7f06dc19aa00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06d000e9c0 tx=0x7f06d000ee80 comp rx=0 tx=0).stop 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 shutdown_connections 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f06c40b65d0 0x7f06c40b8ae0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06dc109df0 0x7f06dc19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06dc1094a0 0x7f06dc19aa00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 --2- 172.21.15.29:0/3025264942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06dc103b60 0x7f06dc19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:51.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 >> 172.21.15.29:0/3025264942 conn(0x7f06dc07b850 msgr2=0x7f06dc1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:51.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 shutdown_connections 2024-09-21T07:07:51.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:51.511+0000 7f06e0e76640 1 -- 172.21.15.29:0/3025264942 wait complete. 2024-09-21T07:07:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:51 smithi029 ceph-mon[30983]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:51 smithi029 ceph-mon[30983]: pgmap v300: 97 pgs: 97 active+clean; 612 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.9 KiB/s wr, 20 op/s 2024-09-21T07:07:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:51 smithi052 ceph-mon[34308]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:51 smithi052 ceph-mon[34308]: pgmap v300: 97 pgs: 97 active+clean; 612 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.9 KiB/s wr, 20 op/s 2024-09-21T07:07:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:51 smithi066 ceph-mon[34793]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:51 smithi066 ceph-mon[34793]: pgmap v300: 97 pgs: 97 active+clean; 612 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.9 KiB/s wr, 20 op/s 2024-09-21T07:07:52.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T07:07:52.503 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:52.903 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:52 smithi029 ceph-mon[30983]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:52.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:52 smithi052 ceph-mon[34308]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 -- 172.21.15.29:0/3259513283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac109df0 msgr2=0x7fe9ac110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/3259513283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac109df0 0x7fe9ac110620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009ca0 tx=0x7fe9a402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 -- 172.21.15.29:0/3259513283 shutdown_connections 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/3259513283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac109df0 0x7fe9ac110620 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/3259513283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9ac1094a0 0x7fe9ac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/3259513283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9ac103b60 0x7fe9ac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 -- 172.21.15.29:0/3259513283 >> 172.21.15.29:0/3259513283 conn(0x7fe9ac07b850 msgr2=0x7fe9ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 -- 172.21.15.29:0/3259513283 shutdown_connections 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 -- 172.21.15.29:0/3259513283 wait complete. 2024-09-21T07:07:53.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.998+0000 7fe9b2f35640 1 Processor -- start 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b2f35640 1 -- start start 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b2f35640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9ac103b60 0x7fe9ac19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b2f35640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac1094a0 0x7fe9ac19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b2f35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9ac109df0 0x7fe9ac19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b2f35640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac113ab0 con 0x7fe9ac1094a0 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b2f35640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac113930 con 0x7fe9ac103b60 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b2f35640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac113c30 con 0x7fe9ac109df0 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac1094a0 0x7fe9ac19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac1094a0 0x7fe9ac19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39556/0 (socket says 172.21.15.29:39556) 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 -- 172.21.15.29:0/2385786186 learned_addr learned my addr 172.21.15.29:0/2385786186 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b0cd1640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9ac103b60 0x7fe9ac19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9b14d2640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9ac109df0 0x7fe9ac19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 -- 172.21.15.29:0/2385786186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9ac109df0 msgr2=0x7fe9ac19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:53.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9ac109df0 0x7fe9ac19fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 -- 172.21.15.29:0/2385786186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9ac103b60 msgr2=0x7fe9ac19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9ac103b60 0x7fe9ac19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 -- 172.21.15.29:0/2385786186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac1a02f0 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:52.999+0000 7fe9abfff640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac1094a0 0x7fe9ac19a9e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000c8c0 tx=0x7fe9a000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.000+0000 7fe9a9ffb640 1 -- 172.21.15.29:0/2385786186 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a0007bb0 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.000+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac1a05e0 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.000+0000 7fe9a9ffb640 1 -- 172.21.15.29:0/2385786186 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9a0007d50 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.000+0000 7fe9a9ffb640 1 -- 172.21.15.29:0/2385786186 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a00187c0 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.000+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac1a6e00 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.001+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac103f70 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.002+0000 7fe9a9ffb640 1 -- 172.21.15.29:0/2385786186 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe9a000fa20 con 0x7fe9ac1094a0 2024-09-21T07:07:53.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.004+0000 7fe9a9ffb640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9940b65d0 0x7fe9940b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:53.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.004+0000 7fe9b0cd1640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9940b65d0 0x7fe9940b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:53.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.004+0000 7fe9a9ffb640 1 -- 172.21.15.29:0/2385786186 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fe9a00e74a0 con 0x7fe9ac1094a0 2024-09-21T07:07:53.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.004+0000 7fe9b0cd1640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9940b65d0 0x7fe9940b8ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0058c0 tx=0x7fe99c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:53.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.008+0000 7fe9a9ffb640 1 -- 172.21.15.29:0/2385786186 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9a0014030 con 0x7fe9ac1094a0 2024-09-21T07:07:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:52 smithi066 ceph-mon[34793]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:53.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.225+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe9ac063800 con 0x7fe9940b65d0 2024-09-21T07:07:53.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.232+0000 7fe9a9ffb640 1 -- 172.21.15.29:0/2385786186 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe9ac063800 con 0x7fe9940b65d0 2024-09-21T07:07:53.233 INFO:teuthology.orchestra.run.smithi029.stdout:/volumes/qa/sv_1/baddd009-7e27-443d-b0ae-50678aacb90d 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9940b65d0 msgr2=0x7fe9940b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9940b65d0 0x7fe9940b8ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe99c0058c0 tx=0x7fe99c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac1094a0 msgr2=0x7fe9ac19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac1094a0 0x7fe9ac19a9e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe9a000c8c0 tx=0x7fe9a000cd80 comp rx=0 tx=0).stop 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 shutdown_connections 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9940b65d0 0x7fe9940b8ae0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9ac109df0 0x7fe9ac19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9ac1094a0 0x7fe9ac19a9e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 --2- 172.21.15.29:0/2385786186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9ac103b60 0x7fe9ac19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:53.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 >> 172.21.15.29:0/2385786186 conn(0x7fe9ac07b850 msgr2=0x7fe9ac105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 shutdown_connections 2024-09-21T07:07:53.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:53.234+0000 7fe9b2f35640 1 -- 172.21.15.29:0/2385786186 wait complete. 2024-09-21T07:07:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:53 smithi052 ceph-mon[34308]: pgmap v301: 97 pgs: 97 active+clean; 613 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.1 KiB/s wr, 22 op/s 2024-09-21T07:07:54.030 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:53 smithi029 ceph-mon[30983]: pgmap v301: 97 pgs: 97 active+clean; 613 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.1 KiB/s wr, 22 op/s 2024-09-21T07:07:54.067 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:07:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:53 smithi066 ceph-mon[34793]: pgmap v301: 97 pgs: 97 active+clean; 613 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.1 KiB/s wr, 22 op/s 2024-09-21T07:07:54.333 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:54.796 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:54 smithi029 ceph-mon[30983]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.884+0000 7fb7b31d0640 1 -- 172.21.15.29:0/3049219599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac103b60 msgr2=0x7fb7ac103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.884+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/3049219599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac103b60 0x7fb7ac103f70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb79c009900 tx=0x7fb79c02a410 comp rx=0 tx=0).stop 2024-09-21T07:07:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 -- 172.21.15.29:0/3049219599 shutdown_connections 2024-09-21T07:07:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/3049219599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7ac109df0 0x7fb7ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/3049219599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ac1094a0 0x7fb7ac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/3049219599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac103b60 0x7fb7ac103f70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 -- 172.21.15.29:0/3049219599 >> 172.21.15.29:0/3049219599 conn(0x7fb7ac07b850 msgr2=0x7fb7ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 -- 172.21.15.29:0/3049219599 shutdown_connections 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 -- 172.21.15.29:0/3049219599 wait complete. 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 Processor -- start 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.885+0000 7fb7b31d0640 1 -- start start 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b31d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ac103b60 0x7fb7ac19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b31d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac1094a0 0x7fb7ac19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b31d0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7ac109df0 0x7fb7ac1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b31d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac113ab0 con 0x7fb7ac1094a0 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b31d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac113930 con 0x7fb7ac103b60 2024-09-21T07:07:54.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b31d0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac113c30 con 0x7fb7ac109df0 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac1094a0 0x7fb7ac19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac1094a0 0x7fb7ac19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39570/0 (socket says 172.21.15.29:39570) 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 -- 172.21.15.29:0/502825730 learned_addr learned my addr 172.21.15.29:0/502825730 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b0f6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ac103b60 0x7fb7ac19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7b176d640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7ac109df0 0x7fb7ac1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 -- 172.21.15.29:0/502825730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7ac109df0 msgr2=0x7fb7ac1a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7ac109df0 0x7fb7ac1a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 -- 172.21.15.29:0/502825730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ac103b60 msgr2=0x7fb7ac19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ac103b60 0x7fb7ac19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.886+0000 7fb7abfff640 1 -- 172.21.15.29:0/502825730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac1a25d0 con 0x7fb7ac1094a0 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.887+0000 7fb7abfff640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac1094a0 0x7fb7ac19cc00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000d740 tx=0x7fb7a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:54.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.887+0000 7fb7a9ffb640 1 -- 172.21.15.29:0/502825730 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0017070 con 0x7fb7ac1094a0 2024-09-21T07:07:54.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.887+0000 7fb7a9ffb640 1 -- 172.21.15.29:0/502825730 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a000de50 con 0x7fb7ac1094a0 2024-09-21T07:07:54.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.887+0000 7fb7a9ffb640 1 -- 172.21.15.29:0/502825730 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a000f620 con 0x7fb7ac1094a0 2024-09-21T07:07:54.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.887+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ac1a28c0 con 0x7fb7ac1094a0 2024-09-21T07:07:54.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.887+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ac1a9020 con 0x7fb7ac1094a0 2024-09-21T07:07:54.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.888+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ac103f70 con 0x7fb7ac1094a0 2024-09-21T07:07:54.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.890+0000 7fb7a9ffb640 1 -- 172.21.15.29:0/502825730 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb7a001a070 con 0x7fb7ac1094a0 2024-09-21T07:07:54.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.890+0000 7fb7a9ffb640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb7940b6620 0x7fb7940b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:54.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.890+0000 7fb7b0f6c640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb7940b6620 0x7fb7940b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:54.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.891+0000 7fb7a9ffb640 1 -- 172.21.15.29:0/502825730 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fb7a00e6b70 con 0x7fb7ac1094a0 2024-09-21T07:07:54.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.891+0000 7fb7b0f6c640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb7940b6620 0x7fb7940b8b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb79c031440 tx=0x7fb79c009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:54.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:54.893+0000 7fb7a9ffb640 1 -- 172.21.15.29:0/502825730 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7a00b18b0 con 0x7fb7ac1094a0 2024-09-21T07:07:54.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:54 smithi052 ceph-mon[34308]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:54 smithi066 ceph-mon[34793]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:07:55.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.118+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7ac19d790 con 0x7fb7ac1094a0 2024-09-21T07:07:55.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.119+0000 7fb7a9ffb640 1 -- 172.21.15.29:0/502825730 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11958 (secure 0 0 0) 0x7fb7ac19d790 con 0x7fb7ac1094a0 2024-09-21T07:07:55.122 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:55.122 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"btime":"2024-09-21T07:07:44:626522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:07:44.626498+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:07:55.123 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb7940b6620 msgr2=0x7fb7940b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb7940b6620 0x7fb7940b8b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb79c031440 tx=0x7fb79c009560 comp rx=0 tx=0).stop 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac1094a0 msgr2=0x7fb7ac19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac1094a0 0x7fb7ac19cc00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000d740 tx=0x7fb7a000dc00 comp rx=0 tx=0).stop 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 shutdown_connections 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb7940b6620 0x7fb7940b8b30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7ac109df0 0x7fb7ac1a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ac1094a0 0x7fb7ac19cc00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 --2- 172.21.15.29:0/502825730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb7ac103b60 0x7fb7ac19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 >> 172.21.15.29:0/502825730 conn(0x7fb7ac07b850 msgr2=0x7fb7ac107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 shutdown_connections 2024-09-21T07:07:55.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:55.122+0000 7fb7b31d0640 1 -- 172.21.15.29:0/502825730 wait complete. 2024-09-21T07:07:55.815 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:55 smithi029 ceph-mon[30983]: pgmap v302: 97 pgs: 97 active+clean; 613 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2024-09-21T07:07:55.815 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:55 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/502825730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:55.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:07:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:55 smithi052 ceph-mon[34308]: pgmap v302: 97 pgs: 97 active+clean; 613 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2024-09-21T07:07:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:55 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/502825730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:55 smithi066 ceph-mon[34793]: pgmap v302: 97 pgs: 97 active+clean; 613 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2024-09-21T07:07:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:55 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/502825730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:07:56.116 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 -- 172.21.15.29:0/1843728824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c01094a0 msgr2=0x7f58c01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 --2- 172.21.15.29:0/1843728824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c01094a0 0x7f58c01098b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009900 tx=0x7f58b402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 -- 172.21.15.29:0/1843728824 shutdown_connections 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 --2- 172.21.15.29:0/1843728824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58c0109df0 0x7f58c0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 --2- 172.21.15.29:0/1843728824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c01094a0 0x7f58c01098b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 --2- 172.21.15.29:0/1843728824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c0103b60 0x7f58c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 -- 172.21.15.29:0/1843728824 >> 172.21.15.29:0/1843728824 conn(0x7f58c007b850 msgr2=0x7f58c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:56.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 -- 172.21.15.29:0/1843728824 shutdown_connections 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.581+0000 7f58c56e1640 1 -- 172.21.15.29:0/1843728824 wait complete. 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 Processor -- start 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 -- start start 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c0103b60 0x7f58c019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58c01094a0 0x7f58c019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c0109df0 0x7f58c019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0113ab0 con 0x7f58c0103b60 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0113930 con 0x7f58c0109df0 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.582+0000 7f58c56e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f58c0113c30 con 0x7f58c01094a0 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c0103b60 0x7f58c019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c0103b60 0x7f58c019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39578/0 (socket says 172.21.15.29:39578) 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 -- 172.21.15.29:0/3837834958 learned_addr learned my addr 172.21.15.29:0/3837834958 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:56.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58bf7fe640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c0109df0 0x7f58c019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58be7fc640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58c01094a0 0x7f58c019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 -- 172.21.15.29:0/3837834958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58c01094a0 msgr2=0x7f58c019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58c01094a0 0x7f58c019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 -- 172.21.15.29:0/3837834958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c0109df0 msgr2=0x7f58c019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c0109df0 0x7f58c019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 -- 172.21.15.29:0/3837834958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c01a04d0 con 0x7f58c0103b60 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58beffd640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c0103b60 0x7f58c019a560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58b000d950 tx=0x7f58b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58a7fff640 1 -- 172.21.15.29:0/3837834958 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0017070 con 0x7f58c0103b60 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58a7fff640 1 -- 172.21.15.29:0/3837834958 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58b0009c30 con 0x7f58c0103b60 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c01a07c0 con 0x7f58c0103b60 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58a7fff640 1 -- 172.21.15.29:0/3837834958 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b000f620 con 0x7f58c0103b60 2024-09-21T07:07:56.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.583+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c01a6f20 con 0x7f58c0103b60 2024-09-21T07:07:56.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.584+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c0103f70 con 0x7f58c0103b60 2024-09-21T07:07:56.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.586+0000 7f58a7fff640 1 -- 172.21.15.29:0/3837834958 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f58b0005030 con 0x7f58c0103b60 2024-09-21T07:07:56.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.587+0000 7f58a7fff640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f58a80b6620 0x7f58a80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:56.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.587+0000 7f58be7fc640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f58a80b6620 0x7f58a80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:56.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.587+0000 7f58a7fff640 1 -- 172.21.15.29:0/3837834958 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f58b00e6dc0 con 0x7f58c0103b60 2024-09-21T07:07:56.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.587+0000 7f58be7fc640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f58a80b6620 0x7f58a80b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009230 tx=0x7f58b4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:56.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.590+0000 7f58a7fff640 1 -- 172.21.15.29:0/3837834958 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58b0009de0 con 0x7f58c0103b60 2024-09-21T07:07:56.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T07:07:56.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T07:07:56.777 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:07:56.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T07:07:56.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-21T07:07:56.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-21T07:07:56.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-21T07:07:56.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:07:56.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.785+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58c019b690 con 0x7f58c0103b60 2024-09-21T07:07:56.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.787+0000 7f58a7fff640 1 -- 172.21.15.29:0/3837834958 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22640 (secure 0 0 0) 0x7f58b00b1b00 con 0x7f58c0103b60 2024-09-21T07:07:56.790 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:56.790 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":74,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:56.652239+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f58a80b6620 msgr2=0x7f58a80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f58a80b6620 0x7f58a80b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009230 tx=0x7f58b4031400 comp rx=0 tx=0).stop 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c0103b60 msgr2=0x7f58c019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c0103b60 0x7f58c019a560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f58b000d950 tx=0x7f58b000de10 comp rx=0 tx=0).stop 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 shutdown_connections 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f58a80b6620 0x7f58a80b8b30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58c0109df0 0x7f58c019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58c01094a0 0x7f58c019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 --2- 172.21.15.29:0/3837834958 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c0103b60 0x7f58c019a560 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:56.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 >> 172.21.15.29:0/3837834958 conn(0x7f58c007b850 msgr2=0x7f58c0105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:56.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 shutdown_connections 2024-09-21T07:07:56.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:56.789+0000 7f58c56e1640 1 -- 172.21.15.29:0/3837834958 wait complete. 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-21T07:07:56.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:07:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-21T07:07:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]} : dispatch 2024-09-21T07:07:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T07:07:57.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T07:07:57.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-21T07:07:57.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2024-09-21T07:07:57.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]} : dispatch 2024-09-21T07:07:57.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T07:07:57.491 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:07:57.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:07:57.760 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 21 op/s 2024-09-21T07:07:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T07:07:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T07:07:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:07:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T07:07:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-21T07:07:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-21T07:07:57.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-21T07:07:57.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:07:57.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:07:57.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:57 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3837834958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 21 op/s 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-21T07:07:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:07:57.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:07:57.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:57 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3837834958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 21 op/s 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-21T07:07:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-21T07:07:58.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T07:07:58.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T07:07:58.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:57 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3837834958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:07:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 -- 172.21.15.29:0/3924900225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0105290 msgr2=0x7fa7a010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 --2- 172.21.15.29:0/3924900225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0105290 0x7fa7a010d8d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa794009900 tx=0x7fa79402a410 comp rx=0 tx=0).stop 2024-09-21T07:07:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 -- 172.21.15.29:0/3924900225 shutdown_connections 2024-09-21T07:07:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 --2- 172.21.15.29:0/3924900225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7a010de10 0x7fa7a0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 --2- 172.21.15.29:0/3924900225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0105290 0x7fa7a010d8d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 --2- 172.21.15.29:0/3924900225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a0104860 0x7fa7a0104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 -- 172.21.15.29:0/3924900225 >> 172.21.15.29:0/3924900225 conn(0x7fa7a0079730 msgr2=0x7fa7a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 -- 172.21.15.29:0/3924900225 shutdown_connections 2024-09-21T07:07:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.297+0000 7fa7a6671640 1 -- 172.21.15.29:0/3924900225 wait complete. 2024-09-21T07:07:58.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 Processor -- start 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 -- start start 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0104860 0x7fa7a019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7a0105290 0x7fa7a019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a010de10 0x7fa7a019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0113a50 con 0x7fa7a0104860 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a01138d0 con 0x7fa7a010de10 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a6671640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0113bd0 con 0x7fa7a0105290 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa79ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0104860 0x7fa7a019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa79ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0104860 0x7fa7a019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50348/0 (socket says 172.21.15.29:50348) 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa79ffff640 1 -- 172.21.15.29:0/1777402300 learned_addr learned my addr 172.21.15.29:0/1777402300 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa79f7fe640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7a0105290 0x7fa7a019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:58.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.298+0000 7fa7a4c0e640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a010de10 0x7fa7a019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79ffff640 1 -- 172.21.15.29:0/1777402300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7a0105290 msgr2=0x7fa7a019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79ffff640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7a0105290 0x7fa7a019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79ffff640 1 -- 172.21.15.29:0/1777402300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a010de10 msgr2=0x7fa7a019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79ffff640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a010de10 0x7fa7a019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79ffff640 1 -- 172.21.15.29:0/1777402300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a01a0450 con 0x7fa7a0104860 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79ffff640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0104860 0x7fa7a019a4e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa79000d950 tx=0x7fa79000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79d7fa640 1 -- 172.21.15.29:0/1777402300 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa790017070 con 0x7fa7a0104860 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79d7fa640 1 -- 172.21.15.29:0/1777402300 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa790009c30 con 0x7fa7a0104860 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa79d7fa640 1 -- 172.21.15.29:0/1777402300 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79000f620 con 0x7fa7a0104860 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a01a0740 con 0x7fa7a0104860 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.299+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a01a6ea0 con 0x7fa7a0104860 2024-09-21T07:07:58.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.300+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a006c200 con 0x7fa7a0104860 2024-09-21T07:07:58.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.303+0000 7fa79d7fa640 1 -- 172.21.15.29:0/1777402300 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa790005030 con 0x7fa7a0104860 2024-09-21T07:07:58.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.304+0000 7fa79d7fa640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa7880b65a0 0x7fa7880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:07:58.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.304+0000 7fa79f7fe640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa7880b65a0 0x7fa7880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:07:58.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.304+0000 7fa79d7fa640 1 -- 172.21.15.29:0/1777402300 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa7900e6fe0 con 0x7fa7a0104860 2024-09-21T07:07:58.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.304+0000 7fa79f7fe640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa7880b65a0 0x7fa7880b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa794009230 tx=0x7fa794031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:07:58.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.307+0000 7fa79d7fa640 1 -- 172.21.15.29:0/1777402300 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa790009de0 con 0x7fa7a0104860 2024-09-21T07:07:58.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.492+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7a0063800 con 0x7fa7880b65a0 2024-09-21T07:07:58.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.498+0000 7fa79d7fa640 1 -- 172.21.15.29:0/1777402300 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258684 (secure 0 0 0) 0x7fa7a0063800 con 0x7fa7880b65a0 2024-09-21T07:07:58.504 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:07:58.505 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T07:07:58.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa7880b65a0 msgr2=0x7fa7880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:58.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa7880b65a0 0x7fa7880b8ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa794009230 tx=0x7fa794031400 comp rx=0 tx=0).stop 2024-09-21T07:07:58.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0104860 msgr2=0x7fa7a019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:07:58.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0104860 0x7fa7a019a4e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa79000d950 tx=0x7fa79000de10 comp rx=0 tx=0).stop 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 shutdown_connections 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa7880b65a0 0x7fa7880b8ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a010de10 0x7fa7a019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7a0105290 0x7fa7a019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 --2- 172.21.15.29:0/1777402300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7a0104860 0x7fa7a019a4e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 >> 172.21.15.29:0/1777402300 conn(0x7fa7a0079730 msgr2=0x7fa7a01008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 shutdown_connections 2024-09-21T07:07:58.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:07:58.501+0000 7fa7a6671640 1 -- 172.21.15.29:0/1777402300 wait complete. 2024-09-21T07:07:58.864 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:58 smithi029 ceph-mon[30983]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:07:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:58 smithi052 ceph-mon[34308]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:07:59.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:58 smithi066 ceph-mon[34793]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T07:07:59.259 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-21T07:07:57.997553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652452,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":230,"num_read_kb":198,"num_write":366,"num_write_kb":2281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385716,"kb_used_data":11496,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556108,"statfs":{"total":1151940427776,"available":1151545454592,"internally_reserved":0,"allocated":11771904,"data_stored":6494381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25748,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":57,"num_write":24,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002237"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573714+0000","last_change":"2024-09-21T07:07:32.566786+0000","last_active":"2024-09-21T07:07:33.573714+0000","last_peered":"2024-09-21T07:07:33.573714+0000","last_clean":"2024-09-21T07:07:33.573714+0000","last_became_active":"2024-09-21T07:07:32.565722+0000","last_became_peered":"2024-09-21T07:07:32.565722+0000","last_unstale":"2024-09-21T07:07:33.573714+0000","last_undegraded":"2024-09-21T07:07:33.573714+0000","last_fullsized":"2024-09-21T07:07:33.573714+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:22.389773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574477+0000","last_change":"2024-09-21T07:07:32.556460+0000","last_active":"2024-09-21T07:07:33.574477+0000","last_peered":"2024-09-21T07:07:33.574477+0000","last_clean":"2024-09-21T07:07:33.574477+0000","last_became_active":"2024-09-21T07:07:32.555738+0000","last_became_peered":"2024-09-21T07:07:32.555738+0000","last_unstale":"2024-09-21T07:07:33.574477+0000","last_undegraded":"2024-09-21T07:07:33.574477+0000","last_fullsized":"2024-09-21T07:07:33.574477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.921413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572563+0000","last_change":"2024-09-21T07:07:32.565814+0000","last_active":"2024-09-21T07:07:33.572563+0000","last_peered":"2024-09-21T07:07:33.572563+0000","last_clean":"2024-09-21T07:07:33.572563+0000","last_became_active":"2024-09-21T07:07:32.565401+0000","last_became_peered":"2024-09-21T07:07:32.565401+0000","last_unstale":"2024-09-21T07:07:33.572563+0000","last_undegraded":"2024-09-21T07:07:33.572563+0000","last_fullsized":"2024-09-21T07:07:33.572563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:56.705903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565506+0000","last_change":"2024-09-21T07:07:32.554713+0000","last_active":"2024-09-21T07:07:33.565506+0000","last_peered":"2024-09-21T07:07:33.565506+0000","last_clean":"2024-09-21T07:07:33.565506+0000","last_became_active":"2024-09-21T07:07:32.554203+0000","last_became_peered":"2024-09-21T07:07:32.554203+0000","last_unstale":"2024-09-21T07:07:33.565506+0000","last_undegraded":"2024-09-21T07:07:33.565506+0000","last_fullsized":"2024-09-21T07:07:33.565506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:29.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666797+0000","last_change":"2024-09-21T07:07:32.566048+0000","last_active":"2024-09-21T07:07:56.666797+0000","last_peered":"2024-09-21T07:07:56.666797+0000","last_clean":"2024-09-21T07:07:56.666797+0000","last_became_active":"2024-09-21T07:07:32.565659+0000","last_became_peered":"2024-09-21T07:07:32.565659+0000","last_unstale":"2024-09-21T07:07:56.666797+0000","last_undegraded":"2024-09-21T07:07:56.666797+0000","last_fullsized":"2024-09-21T07:07:56.666797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:56.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573776+0000","last_change":"2024-09-21T07:07:32.550492+0000","last_active":"2024-09-21T07:07:33.573776+0000","last_peered":"2024-09-21T07:07:33.573776+0000","last_clean":"2024-09-21T07:07:33.573776+0000","last_became_active":"2024-09-21T07:07:32.549691+0000","last_became_peered":"2024-09-21T07:07:32.549691+0000","last_unstale":"2024-09-21T07:07:33.573776+0000","last_undegraded":"2024-09-21T07:07:33.573776+0000","last_fullsized":"2024-09-21T07:07:33.573776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.890164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572221+0000","last_change":"2024-09-21T07:07:32.560258+0000","last_active":"2024-09-21T07:07:33.572221+0000","last_peered":"2024-09-21T07:07:33.572221+0000","last_clean":"2024-09-21T07:07:33.572221+0000","last_became_active":"2024-09-21T07:07:32.559890+0000","last_became_peered":"2024-09-21T07:07:32.559890+0000","last_unstale":"2024-09-21T07:07:33.572221+0000","last_undegraded":"2024-09-21T07:07:33.572221+0000","last_fullsized":"2024-09-21T07:07:33.572221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.794736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573718+0000","last_change":"2024-09-21T07:07:32.560923+0000","last_active":"2024-09-21T07:07:33.573718+0000","last_peered":"2024-09-21T07:07:33.573718+0000","last_clean":"2024-09-21T07:07:33.573718+0000","last_became_active":"2024-09-21T07:07:32.560509+0000","last_became_peered":"2024-09-21T07:07:32.560509+0000","last_unstale":"2024-09-21T07:07:33.573718+0000","last_undegraded":"2024-09-21T07:07:33.573718+0000","last_fullsized":"2024-09-21T07:07:33.573718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:59.576434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.664977+0000","last_change":"2024-09-21T07:07:32.564475+0000","last_active":"2024-09-21T07:07:56.664977+0000","last_peered":"2024-09-21T07:07:56.664977+0000","last_clean":"2024-09-21T07:07:56.664977+0000","last_became_active":"2024-09-21T07:07:32.564115+0000","last_became_peered":"2024-09-21T07:07:32.564115+0000","last_unstale":"2024-09-21T07:07:56.664977+0000","last_undegraded":"2024-09-21T07:07:56.664977+0000","last_fullsized":"2024-09-21T07:07:56.664977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:03.989109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575213+0000","last_change":"2024-09-21T07:07:32.557377+0000","last_active":"2024-09-21T07:07:33.575213+0000","last_peered":"2024-09-21T07:07:33.575213+0000","last_clean":"2024-09-21T07:07:33.575213+0000","last_became_active":"2024-09-21T07:07:32.556732+0000","last_became_peered":"2024-09-21T07:07:32.556732+0000","last_unstale":"2024-09-21T07:07:33.575213+0000","last_undegraded":"2024-09-21T07:07:33.575213+0000","last_fullsized":"2024-09-21T07:07:33.575213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:32.474690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574804+0000","last_change":"2024-09-21T07:07:32.558691+0000","last_active":"2024-09-21T07:07:33.574804+0000","last_peered":"2024-09-21T07:07:33.574804+0000","last_clean":"2024-09-21T07:07:33.574804+0000","last_became_active":"2024-09-21T07:07:32.558029+0000","last_became_peered":"2024-09-21T07:07:32.558029+0000","last_unstale":"2024-09-21T07:07:33.574804+0000","last_undegraded":"2024-09-21T07:07:33.574804+0000","last_fullsized":"2024-09-21T07:07:33.574804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.378786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565633+0000","last_change":"2024-09-21T07:07:32.556500+0000","last_active":"2024-09-21T07:07:33.565633+0000","last_peered":"2024-09-21T07:07:33.565633+0000","last_clean":"2024-09-21T07:07:33.565633+0000","last_became_active":"2024-09-21T07:07:32.555529+0000","last_became_peered":"2024-09-21T07:07:32.555529+0000","last_unstale":"2024-09-21T07:07:33.565633+0000","last_undegraded":"2024-09-21T07:07:33.565633+0000","last_fullsized":"2024-09-21T07:07:33.565633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.494498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564386+0000","last_change":"2024-09-21T07:07:32.560235+0000","last_active":"2024-09-21T07:07:33.564386+0000","last_peered":"2024-09-21T07:07:33.564386+0000","last_clean":"2024-09-21T07:07:33.564386+0000","last_became_active":"2024-09-21T07:07:32.559834+0000","last_became_peered":"2024-09-21T07:07:32.559834+0000","last_unstale":"2024-09-21T07:07:33.564386+0000","last_undegraded":"2024-09-21T07:07:33.564386+0000","last_fullsized":"2024-09-21T07:07:33.564386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:30.090878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572860+0000","last_change":"2024-09-21T07:07:32.554158+0000","last_active":"2024-09-21T07:07:33.572860+0000","last_peered":"2024-09-21T07:07:33.572860+0000","last_clean":"2024-09-21T07:07:33.572860+0000","last_became_active":"2024-09-21T07:07:32.553837+0000","last_became_peered":"2024-09-21T07:07:32.553837+0000","last_unstale":"2024-09-21T07:07:33.572860+0000","last_undegraded":"2024-09-21T07:07:33.572860+0000","last_fullsized":"2024-09-21T07:07:33.572860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:23.845629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572280+0000","last_change":"2024-09-21T07:07:32.556921+0000","last_active":"2024-09-21T07:07:33.572280+0000","last_peered":"2024-09-21T07:07:33.572280+0000","last_clean":"2024-09-21T07:07:33.572280+0000","last_became_active":"2024-09-21T07:07:32.556529+0000","last_became_peered":"2024-09-21T07:07:32.556529+0000","last_unstale":"2024-09-21T07:07:33.572280+0000","last_undegraded":"2024-09-21T07:07:33.572280+0000","last_fullsized":"2024-09-21T07:07:33.572280+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.447617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665137+0000","last_change":"2024-09-21T07:07:32.567572+0000","last_active":"2024-09-21T07:07:56.665137+0000","last_peered":"2024-09-21T07:07:56.665137+0000","last_clean":"2024-09-21T07:07:56.665137+0000","last_became_active":"2024-09-21T07:07:32.567159+0000","last_became_peered":"2024-09-21T07:07:32.567159+0000","last_unstale":"2024-09-21T07:07:56.665137+0000","last_undegraded":"2024-09-21T07:07:56.665137+0000","last_fullsized":"2024-09-21T07:07:56.665137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.316539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574273+0000","last_change":"2024-09-21T07:07:32.567213+0000","last_active":"2024-09-21T07:07:33.574273+0000","last_peered":"2024-09-21T07:07:33.574273+0000","last_clean":"2024-09-21T07:07:33.574273+0000","last_became_active":"2024-09-21T07:07:32.566284+0000","last_became_peered":"2024-09-21T07:07:32.566284+0000","last_unstale":"2024-09-21T07:07:33.574273+0000","last_undegraded":"2024-09-21T07:07:33.574273+0000","last_fullsized":"2024-09-21T07:07:33.574273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663157+0000","last_change":"2024-09-21T07:07:32.551695+0000","last_active":"2024-09-21T07:07:56.663157+0000","last_peered":"2024-09-21T07:07:56.663157+0000","last_clean":"2024-09-21T07:07:56.663157+0000","last_became_active":"2024-09-21T07:07:32.551282+0000","last_became_peered":"2024-09-21T07:07:32.551282+0000","last_unstale":"2024-09-21T07:07:56.663157+0000","last_undegraded":"2024-09-21T07:07:56.663157+0000","last_fullsized":"2024-09-21T07:07:56.663157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:33.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669799+0000","last_change":"2024-09-21T07:07:32.551000+0000","last_active":"2024-09-21T07:07:57.669799+0000","last_peered":"2024-09-21T07:07:57.669799+0000","last_clean":"2024-09-21T07:07:57.669799+0000","last_became_active":"2024-09-21T07:07:32.550590+0000","last_became_peered":"2024-09-21T07:07:32.550590+0000","last_unstale":"2024-09-21T07:07:57.669799+0000","last_undegraded":"2024-09-21T07:07:57.669799+0000","last_fullsized":"2024-09-21T07:07:57.669799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:30.213470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575297+0000","last_change":"2024-09-21T07:07:32.568202+0000","last_active":"2024-09-21T07:07:33.575297+0000","last_peered":"2024-09-21T07:07:33.575297+0000","last_clean":"2024-09-21T07:07:33.575297+0000","last_became_active":"2024-09-21T07:07:32.567794+0000","last_became_peered":"2024-09-21T07:07:32.567794+0000","last_unstale":"2024-09-21T07:07:33.575297+0000","last_undegraded":"2024-09-21T07:07:33.575297+0000","last_fullsized":"2024-09-21T07:07:33.575297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:45.556074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564501+0000","last_change":"2024-09-21T07:07:32.555752+0000","last_active":"2024-09-21T07:07:33.564501+0000","last_peered":"2024-09-21T07:07:33.564501+0000","last_clean":"2024-09-21T07:07:33.564501+0000","last_became_active":"2024-09-21T07:07:32.555057+0000","last_became_peered":"2024-09-21T07:07:32.555057+0000","last_unstale":"2024-09-21T07:07:33.564501+0000","last_undegraded":"2024-09-21T07:07:33.564501+0000","last_fullsized":"2024-09-21T07:07:33.564501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:03.161990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666031+0000","last_change":"2024-09-21T07:07:32.555589+0000","last_active":"2024-09-21T07:07:56.666031+0000","last_peered":"2024-09-21T07:07:56.666031+0000","last_clean":"2024-09-21T07:07:56.666031+0000","last_became_active":"2024-09-21T07:07:32.555037+0000","last_became_peered":"2024-09-21T07:07:32.555037+0000","last_unstale":"2024-09-21T07:07:56.666031+0000","last_undegraded":"2024-09-21T07:07:56.666031+0000","last_fullsized":"2024-09-21T07:07:56.666031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:25.346546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573881+0000","last_change":"2024-09-21T07:07:32.559407+0000","last_active":"2024-09-21T07:07:33.573881+0000","last_peered":"2024-09-21T07:07:33.573881+0000","last_clean":"2024-09-21T07:07:33.573881+0000","last_became_active":"2024-09-21T07:07:32.559112+0000","last_became_peered":"2024-09-21T07:07:32.559112+0000","last_unstale":"2024-09-21T07:07:33.573881+0000","last_undegraded":"2024-09-21T07:07:33.573881+0000","last_fullsized":"2024-09-21T07:07:33.573881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:13.970511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564994+0000","last_change":"2024-09-21T07:07:32.564798+0000","last_active":"2024-09-21T07:07:33.564994+0000","last_peered":"2024-09-21T07:07:33.564994+0000","last_clean":"2024-09-21T07:07:33.564994+0000","last_became_active":"2024-09-21T07:07:32.564381+0000","last_became_peered":"2024-09-21T07:07:32.564381+0000","last_unstale":"2024-09-21T07:07:33.564994+0000","last_undegraded":"2024-09-21T07:07:33.564994+0000","last_fullsized":"2024-09-21T07:07:33.564994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:19.667252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574263+0000","last_change":"2024-09-21T07:07:32.555274+0000","last_active":"2024-09-21T07:07:33.574263+0000","last_peered":"2024-09-21T07:07:33.574263+0000","last_clean":"2024-09-21T07:07:33.574263+0000","last_became_active":"2024-09-21T07:07:32.554816+0000","last_became_peered":"2024-09-21T07:07:32.554816+0000","last_unstale":"2024-09-21T07:07:33.574263+0000","last_undegraded":"2024-09-21T07:07:33.574263+0000","last_fullsized":"2024-09-21T07:07:33.574263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.018974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.671064+0000","last_change":"2024-09-21T07:07:32.555655+0000","last_active":"2024-09-21T07:07:57.671064+0000","last_peered":"2024-09-21T07:07:57.671064+0000","last_clean":"2024-09-21T07:07:57.671064+0000","last_became_active":"2024-09-21T07:07:32.555240+0000","last_became_peered":"2024-09-21T07:07:32.555240+0000","last_unstale":"2024-09-21T07:07:57.671064+0000","last_undegraded":"2024-09-21T07:07:57.671064+0000","last_fullsized":"2024-09-21T07:07:57.671064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:51.550091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573670+0000","last_change":"2024-09-21T07:07:32.570761+0000","last_active":"2024-09-21T07:07:33.573670+0000","last_peered":"2024-09-21T07:07:33.573670+0000","last_clean":"2024-09-21T07:07:33.573670+0000","last_became_active":"2024-09-21T07:07:32.569555+0000","last_became_peered":"2024-09-21T07:07:32.569555+0000","last_unstale":"2024-09-21T07:07:33.573670+0000","last_undegraded":"2024-09-21T07:07:33.573670+0000","last_fullsized":"2024-09-21T07:07:33.573670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:23.414096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564554+0000","last_change":"2024-09-21T07:07:32.548955+0000","last_active":"2024-09-21T07:07:33.564554+0000","last_peered":"2024-09-21T07:07:33.564554+0000","last_clean":"2024-09-21T07:07:33.564554+0000","last_became_active":"2024-09-21T07:07:32.548562+0000","last_became_peered":"2024-09-21T07:07:32.548562+0000","last_unstale":"2024-09-21T07:07:33.564554+0000","last_undegraded":"2024-09-21T07:07:33.564554+0000","last_fullsized":"2024-09-21T07:07:33.564554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:24.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572567+0000","last_change":"2024-09-21T07:07:32.550889+0000","last_active":"2024-09-21T07:07:33.572567+0000","last_peered":"2024-09-21T07:07:33.572567+0000","last_clean":"2024-09-21T07:07:33.572567+0000","last_became_active":"2024-09-21T07:07:32.550559+0000","last_became_peered":"2024-09-21T07:07:32.550559+0000","last_unstale":"2024-09-21T07:07:33.572567+0000","last_undegraded":"2024-09-21T07:07:33.572567+0000","last_fullsized":"2024-09-21T07:07:33.572567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:35.575626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669528+0000","last_change":"2024-09-21T07:07:32.552019+0000","last_active":"2024-09-21T07:07:57.669528+0000","last_peered":"2024-09-21T07:07:57.669528+0000","last_clean":"2024-09-21T07:07:57.669528+0000","last_became_active":"2024-09-21T07:07:32.551562+0000","last_became_peered":"2024-09-21T07:07:32.551562+0000","last_unstale":"2024-09-21T07:07:57.669528+0000","last_undegraded":"2024-09-21T07:07:57.669528+0000","last_fullsized":"2024-09-21T07:07:57.669528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:25.932560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669832+0000","last_change":"2024-09-21T07:07:32.556938+0000","last_active":"2024-09-21T07:07:57.669832+0000","last_peered":"2024-09-21T07:07:57.669832+0000","last_clean":"2024-09-21T07:07:57.669832+0000","last_became_active":"2024-09-21T07:07:32.556331+0000","last_became_peered":"2024-09-21T07:07:32.556331+0000","last_unstale":"2024-09-21T07:07:57.669832+0000","last_undegraded":"2024-09-21T07:07:57.669832+0000","last_fullsized":"2024-09-21T07:07:57.669832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.358076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572681+0000","last_change":"2024-09-21T07:07:32.561984+0000","last_active":"2024-09-21T07:07:33.572681+0000","last_peered":"2024-09-21T07:07:33.572681+0000","last_clean":"2024-09-21T07:07:33.572681+0000","last_became_active":"2024-09-21T07:07:32.561227+0000","last_became_peered":"2024-09-21T07:07:32.561227+0000","last_unstale":"2024-09-21T07:07:33.572681+0000","last_undegraded":"2024-09-21T07:07:33.572681+0000","last_fullsized":"2024-09-21T07:07:33.572681+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:35.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.667130+0000","last_change":"2024-09-21T07:07:32.567454+0000","last_active":"2024-09-21T07:07:56.667130+0000","last_peered":"2024-09-21T07:07:56.667130+0000","last_clean":"2024-09-21T07:07:56.667130+0000","last_became_active":"2024-09-21T07:07:32.567063+0000","last_became_peered":"2024-09-21T07:07:32.567063+0000","last_unstale":"2024-09-21T07:07:56.667130+0000","last_undegraded":"2024-09-21T07:07:56.667130+0000","last_fullsized":"2024-09-21T07:07:56.667130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.466771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653759+0000","last_change":"2024-09-21T07:07:30.548785+0000","last_active":"2024-09-21T07:07:54.653759+0000","last_peered":"2024-09-21T07:07:54.653759+0000","last_clean":"2024-09-21T07:07:54.653759+0000","last_became_active":"2024-09-21T07:07:30.547764+0000","last_became_peered":"2024-09-21T07:07:30.547764+0000","last_unstale":"2024-09-21T07:07:54.653759+0000","last_undegraded":"2024-09-21T07:07:54.653759+0000","last_fullsized":"2024-09-21T07:07:54.653759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:18.115002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":74,"state":"peering","last_fresh":"2024-09-21T07:07:32.545905+0000","last_change":"2024-09-21T07:07:57.652924+0000","last_active":"2024-09-21T07:07:31.529868+0000","last_peered":"2024-09-21T07:07:31.529868+0000","last_clean":"2024-09-21T07:07:31.529868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:07:32.545905+0000","last_undegraded":"2024-09-21T07:07:32.545905+0000","last_fullsized":"2024-09-21T07:07:32.545905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:42.621679+0000","last_change":"2024-09-21T07:07:30.546038+0000","last_active":"2024-09-21T07:07:42.621679+0000","last_peered":"2024-09-21T07:07:42.621679+0000","last_clean":"2024-09-21T07:07:42.621679+0000","last_became_active":"2024-09-21T07:07:30.545571+0000","last_became_peered":"2024-09-21T07:07:30.545571+0000","last_unstale":"2024-09-21T07:07:42.621679+0000","last_undegraded":"2024-09-21T07:07:42.621679+0000","last_fullsized":"2024-09-21T07:07:42.621679+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:56.323216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:41.612579+0000","last_change":"2024-09-21T07:07:30.539941+0000","last_active":"2024-09-21T07:07:41.612579+0000","last_peered":"2024-09-21T07:07:41.612579+0000","last_clean":"2024-09-21T07:07:41.612579+0000","last_became_active":"2024-09-21T07:07:30.539401+0000","last_became_peered":"2024-09-21T07:07:30.539401+0000","last_unstale":"2024-09-21T07:07:41.612579+0000","last_undegraded":"2024-09-21T07:07:41.612579+0000","last_fullsized":"2024-09-21T07:07:41.612579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:15.184453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573819+0000","last_change":"2024-09-21T07:07:32.556958+0000","last_active":"2024-09-21T07:07:33.573819+0000","last_peered":"2024-09-21T07:07:33.573819+0000","last_clean":"2024-09-21T07:07:33.573819+0000","last_became_active":"2024-09-21T07:07:32.556581+0000","last_became_peered":"2024-09-21T07:07:32.556581+0000","last_unstale":"2024-09-21T07:07:33.573819+0000","last_undegraded":"2024-09-21T07:07:33.573819+0000","last_fullsized":"2024-09-21T07:07:33.573819+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:57.618263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.630774+0000","last_change":"2024-09-21T07:07:30.547760+0000","last_active":"2024-09-21T07:07:43.630774+0000","last_peered":"2024-09-21T07:07:43.630774+0000","last_clean":"2024-09-21T07:07:43.630774+0000","last_became_active":"2024-09-21T07:07:30.547327+0000","last_became_peered":"2024-09-21T07:07:30.547327+0000","last_unstale":"2024-09-21T07:07:43.630774+0000","last_undegraded":"2024-09-21T07:07:43.630774+0000","last_fullsized":"2024-09-21T07:07:43.630774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:01.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.662668+0000","last_change":"2024-09-21T07:07:32.552691+0000","last_active":"2024-09-21T07:07:56.662668+0000","last_peered":"2024-09-21T07:07:56.662668+0000","last_clean":"2024-09-21T07:07:56.662668+0000","last_became_active":"2024-09-21T07:07:32.552321+0000","last_became_peered":"2024-09-21T07:07:32.552321+0000","last_unstale":"2024-09-21T07:07:56.662668+0000","last_undegraded":"2024-09-21T07:07:56.662668+0000","last_fullsized":"2024-09-21T07:07:56.662668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:56.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":43,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:53.651511+0000","last_change":"2024-09-21T07:07:30.545281+0000","last_active":"2024-09-21T07:07:53.651511+0000","last_peered":"2024-09-21T07:07:53.651511+0000","last_clean":"2024-09-21T07:07:53.651511+0000","last_became_active":"2024-09-21T07:07:30.544823+0000","last_became_peered":"2024-09-21T07:07:30.544823+0000","last_unstale":"2024-09-21T07:07:53.651511+0000","last_undegraded":"2024-09-21T07:07:53.651511+0000","last_fullsized":"2024-09-21T07:07:53.651511+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.659421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.664484+0000","last_change":"2024-09-21T07:07:32.567833+0000","last_active":"2024-09-21T07:07:56.664484+0000","last_peered":"2024-09-21T07:07:56.664484+0000","last_clean":"2024-09-21T07:07:56.664484+0000","last_became_active":"2024-09-21T07:07:32.566902+0000","last_became_peered":"2024-09-21T07:07:32.566902+0000","last_unstale":"2024-09-21T07:07:56.664484+0000","last_undegraded":"2024-09-21T07:07:56.664484+0000","last_fullsized":"2024-09-21T07:07:56.664484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.871038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.628135+0000","last_change":"2024-09-21T07:07:30.546031+0000","last_active":"2024-09-21T07:07:43.628135+0000","last_peered":"2024-09-21T07:07:43.628135+0000","last_clean":"2024-09-21T07:07:43.628135+0000","last_became_active":"2024-09-21T07:07:30.545658+0000","last_became_peered":"2024-09-21T07:07:30.545658+0000","last_unstale":"2024-09-21T07:07:43.628135+0000","last_undegraded":"2024-09-21T07:07:43.628135+0000","last_fullsized":"2024-09-21T07:07:43.628135+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:20.359374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574873+0000","last_change":"2024-09-21T07:07:32.561445+0000","last_active":"2024-09-21T07:07:33.574873+0000","last_peered":"2024-09-21T07:07:33.574873+0000","last_clean":"2024-09-21T07:07:33.574873+0000","last_became_active":"2024-09-21T07:07:32.561033+0000","last_became_peered":"2024-09-21T07:07:32.561033+0000","last_unstale":"2024-09-21T07:07:33.574873+0000","last_undegraded":"2024-09-21T07:07:33.574873+0000","last_fullsized":"2024-09-21T07:07:33.574873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:30.261234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:42.621920+0000","last_change":"2024-09-21T07:07:30.755110+0000","last_active":"2024-09-21T07:07:42.621920+0000","last_peered":"2024-09-21T07:07:42.621920+0000","last_clean":"2024-09-21T07:07:42.621920+0000","last_became_active":"2024-09-21T07:07:30.754680+0000","last_became_peered":"2024-09-21T07:07:30.754680+0000","last_unstale":"2024-09-21T07:07:42.621920+0000","last_undegraded":"2024-09-21T07:07:42.621920+0000","last_fullsized":"2024-09-21T07:07:42.621920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.202010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665839+0000","last_change":"2024-09-21T07:07:32.557349+0000","last_active":"2024-09-21T07:07:56.665839+0000","last_peered":"2024-09-21T07:07:56.665839+0000","last_clean":"2024-09-21T07:07:56.665839+0000","last_became_active":"2024-09-21T07:07:32.554342+0000","last_became_peered":"2024-09-21T07:07:32.554342+0000","last_unstale":"2024-09-21T07:07:56.665839+0000","last_undegraded":"2024-09-21T07:07:56.665839+0000","last_fullsized":"2024-09-21T07:07:56.665839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:21.356410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'27","reported_seq":72,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:53.883401+0000","last_change":"2024-09-21T07:07:30.547691+0000","last_active":"2024-09-21T07:07:53.883401+0000","last_peered":"2024-09-21T07:07:53.883401+0000","last_clean":"2024-09-21T07:07:53.883401+0000","last_became_active":"2024-09-21T07:07:30.547280+0000","last_became_peered":"2024-09-21T07:07:30.547280+0000","last_unstale":"2024-09-21T07:07:53.883401+0000","last_undegraded":"2024-09-21T07:07:53.883401+0000","last_fullsized":"2024-09-21T07:07:53.883401+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:24.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54255,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":56,"num_write":29,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.668576+0000","last_change":"2024-09-21T07:07:32.569291+0000","last_active":"2024-09-21T07:07:56.668576+0000","last_peered":"2024-09-21T07:07:56.668576+0000","last_clean":"2024-09-21T07:07:56.668576+0000","last_became_active":"2024-09-21T07:07:32.568503+0000","last_became_peered":"2024-09-21T07:07:32.568503+0000","last_unstale":"2024-09-21T07:07:56.668576+0000","last_undegraded":"2024-09-21T07:07:56.668576+0000","last_fullsized":"2024-09-21T07:07:56.668576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:56.184795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669620+0000","last_change":"2024-09-21T07:07:30.546624+0000","last_active":"2024-09-21T07:07:57.669620+0000","last_peered":"2024-09-21T07:07:57.669620+0000","last_clean":"2024-09-21T07:07:57.669620+0000","last_became_active":"2024-09-21T07:07:30.545497+0000","last_became_peered":"2024-09-21T07:07:30.545497+0000","last_unstale":"2024-09-21T07:07:57.669620+0000","last_undegraded":"2024-09-21T07:07:57.669620+0000","last_fullsized":"2024-09-21T07:07:57.669620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.963089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564151+0000","last_change":"2024-09-21T07:07:32.551123+0000","last_active":"2024-09-21T07:07:33.564151+0000","last_peered":"2024-09-21T07:07:33.564151+0000","last_clean":"2024-09-21T07:07:33.564151+0000","last_became_active":"2024-09-21T07:07:32.550423+0000","last_became_peered":"2024-09-21T07:07:32.550423+0000","last_unstale":"2024-09-21T07:07:33.564151+0000","last_undegraded":"2024-09-21T07:07:33.564151+0000","last_fullsized":"2024-09-21T07:07:33.564151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:00.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.630375+0000","last_change":"2024-09-21T07:07:30.550102+0000","last_active":"2024-09-21T07:07:43.630375+0000","last_peered":"2024-09-21T07:07:43.630375+0000","last_clean":"2024-09-21T07:07:43.630375+0000","last_became_active":"2024-09-21T07:07:30.549609+0000","last_became_peered":"2024-09-21T07:07:30.549609+0000","last_unstale":"2024-09-21T07:07:43.630375+0000","last_undegraded":"2024-09-21T07:07:43.630375+0000","last_fullsized":"2024-09-21T07:07:43.630375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:58.587612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573964+0000","last_change":"2024-09-21T07:07:32.556167+0000","last_active":"2024-09-21T07:07:33.573964+0000","last_peered":"2024-09-21T07:07:33.573964+0000","last_clean":"2024-09-21T07:07:33.573964+0000","last_became_active":"2024-09-21T07:07:32.555372+0000","last_became_peered":"2024-09-21T07:07:32.555372+0000","last_unstale":"2024-09-21T07:07:33.573964+0000","last_undegraded":"2024-09-21T07:07:33.573964+0000","last_fullsized":"2024-09-21T07:07:33.573964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:35.056919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653941+0000","last_change":"2024-09-21T07:07:30.543196+0000","last_active":"2024-09-21T07:07:54.653941+0000","last_peered":"2024-09-21T07:07:54.653941+0000","last_clean":"2024-09-21T07:07:54.653941+0000","last_became_active":"2024-09-21T07:07:30.542755+0000","last_became_peered":"2024-09-21T07:07:30.542755+0000","last_unstale":"2024-09-21T07:07:54.653941+0000","last_undegraded":"2024-09-21T07:07:54.653941+0000","last_fullsized":"2024-09-21T07:07:54.653941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:14.821703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572622+0000","last_change":"2024-09-21T07:07:32.561243+0000","last_active":"2024-09-21T07:07:33.572622+0000","last_peered":"2024-09-21T07:07:33.572622+0000","last_clean":"2024-09-21T07:07:33.572622+0000","last_became_active":"2024-09-21T07:07:32.560878+0000","last_became_peered":"2024-09-21T07:07:32.560878+0000","last_unstale":"2024-09-21T07:07:33.572622+0000","last_undegraded":"2024-09-21T07:07:33.572622+0000","last_fullsized":"2024-09-21T07:07:33.572622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:19.342422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666167+0000","last_change":"2024-09-21T07:07:30.754985+0000","last_active":"2024-09-21T07:07:56.666167+0000","last_peered":"2024-09-21T07:07:56.666167+0000","last_clean":"2024-09-21T07:07:56.666167+0000","last_became_active":"2024-09-21T07:07:30.754490+0000","last_became_peered":"2024-09-21T07:07:30.754490+0000","last_unstale":"2024-09-21T07:07:56.666167+0000","last_undegraded":"2024-09-21T07:07:56.666167+0000","last_fullsized":"2024-09-21T07:07:56.666167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:21.645643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565523+0000","last_change":"2024-09-21T07:07:32.567997+0000","last_active":"2024-09-21T07:07:33.565523+0000","last_peered":"2024-09-21T07:07:33.565523+0000","last_clean":"2024-09-21T07:07:33.565523+0000","last_became_active":"2024-09-21T07:07:32.567314+0000","last_became_peered":"2024-09-21T07:07:32.567314+0000","last_unstale":"2024-09-21T07:07:33.565523+0000","last_undegraded":"2024-09-21T07:07:33.565523+0000","last_fullsized":"2024-09-21T07:07:33.565523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:07.741967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.607244+0000","last_change":"2024-09-21T07:07:30.545072+0000","last_active":"2024-09-21T07:07:43.607244+0000","last_peered":"2024-09-21T07:07:43.607244+0000","last_clean":"2024-09-21T07:07:43.607244+0000","last_became_active":"2024-09-21T07:07:30.544074+0000","last_became_peered":"2024-09-21T07:07:30.544074+0000","last_unstale":"2024-09-21T07:07:43.607244+0000","last_undegraded":"2024-09-21T07:07:43.607244+0000","last_fullsized":"2024-09-21T07:07:43.607244+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:45.734550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574718+0000","last_change":"2024-09-21T07:07:32.563380+0000","last_active":"2024-09-21T07:07:33.574718+0000","last_peered":"2024-09-21T07:07:33.574718+0000","last_clean":"2024-09-21T07:07:33.574718+0000","last_became_active":"2024-09-21T07:07:32.563012+0000","last_became_peered":"2024-09-21T07:07:32.563012+0000","last_unstale":"2024-09-21T07:07:33.574718+0000","last_undegraded":"2024-09-21T07:07:33.574718+0000","last_fullsized":"2024-09-21T07:07:33.574718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.627703+0000","last_change":"2024-09-21T07:07:30.546448+0000","last_active":"2024-09-21T07:07:43.627703+0000","last_peered":"2024-09-21T07:07:43.627703+0000","last_clean":"2024-09-21T07:07:43.627703+0000","last_became_active":"2024-09-21T07:07:30.546015+0000","last_became_peered":"2024-09-21T07:07:30.546015+0000","last_unstale":"2024-09-21T07:07:43.627703+0000","last_undegraded":"2024-09-21T07:07:43.627703+0000","last_fullsized":"2024-09-21T07:07:43.627703+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:23.041651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572538+0000","last_change":"2024-09-21T07:07:32.562533+0000","last_active":"2024-09-21T07:07:33.572538+0000","last_peered":"2024-09-21T07:07:33.572538+0000","last_clean":"2024-09-21T07:07:33.572538+0000","last_became_active":"2024-09-21T07:07:32.562101+0000","last_became_peered":"2024-09-21T07:07:32.562101+0000","last_unstale":"2024-09-21T07:07:33.572538+0000","last_undegraded":"2024-09-21T07:07:33.572538+0000","last_fullsized":"2024-09-21T07:07:33.572538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:49.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.629665+0000","last_change":"2024-09-21T07:07:30.547263+0000","last_active":"2024-09-21T07:07:43.629665+0000","last_peered":"2024-09-21T07:07:43.629665+0000","last_clean":"2024-09-21T07:07:43.629665+0000","last_became_active":"2024-09-21T07:07:30.546874+0000","last_became_peered":"2024-09-21T07:07:30.546874+0000","last_unstale":"2024-09-21T07:07:43.629665+0000","last_undegraded":"2024-09-21T07:07:43.629665+0000","last_fullsized":"2024-09-21T07:07:43.629665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:18.545407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575642+0000","last_change":"2024-09-21T07:07:32.560288+0000","last_active":"2024-09-21T07:07:33.575642+0000","last_peered":"2024-09-21T07:07:33.575642+0000","last_clean":"2024-09-21T07:07:33.575642+0000","last_became_active":"2024-09-21T07:07:32.559938+0000","last_became_peered":"2024-09-21T07:07:32.559938+0000","last_unstale":"2024-09-21T07:07:33.575642+0000","last_undegraded":"2024-09-21T07:07:33.575642+0000","last_fullsized":"2024-09-21T07:07:33.575642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:55.531828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.672285+0000","last_change":"2024-09-21T07:07:30.754602+0000","last_active":"2024-09-21T07:07:57.672285+0000","last_peered":"2024-09-21T07:07:57.672285+0000","last_clean":"2024-09-21T07:07:57.672285+0000","last_became_active":"2024-09-21T07:07:30.754159+0000","last_became_peered":"2024-09-21T07:07:30.754159+0000","last_unstale":"2024-09-21T07:07:57.672285+0000","last_undegraded":"2024-09-21T07:07:57.672285+0000","last_fullsized":"2024-09-21T07:07:57.672285+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575056+0000","last_change":"2024-09-21T07:07:32.557819+0000","last_active":"2024-09-21T07:07:33.575056+0000","last_peered":"2024-09-21T07:07:33.575056+0000","last_clean":"2024-09-21T07:07:33.575056+0000","last_became_active":"2024-09-21T07:07:32.557363+0000","last_became_peered":"2024-09-21T07:07:32.557363+0000","last_unstale":"2024-09-21T07:07:33.575056+0000","last_undegraded":"2024-09-21T07:07:33.575056+0000","last_fullsized":"2024-09-21T07:07:33.575056+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.802658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":92,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572574+0000","last_change":"2024-09-21T07:06:20.138629+0000","last_active":"2024-09-21T07:07:33.572574+0000","last_peered":"2024-09-21T07:07:33.572574+0000","last_clean":"2024-09-21T07:07:33.572574+0000","last_became_active":"2024-09-21T07:06:20.132041+0000","last_became_peered":"2024-09-21T07:06:20.132041+0000","last_unstale":"2024-09-21T07:07:33.572574+0000","last_undegraded":"2024-09-21T07:07:33.572574+0000","last_fullsized":"2024-09-21T07:07:33.572574+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_clean_scrub_stamp":"2024-09-21T07:02:52.790893+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:41.784916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:44.633409+0000","last_change":"2024-09-21T07:07:30.541638+0000","last_active":"2024-09-21T07:07:44.633409+0000","last_peered":"2024-09-21T07:07:44.633409+0000","last_clean":"2024-09-21T07:07:44.633409+0000","last_became_active":"2024-09-21T07:07:30.541185+0000","last_became_peered":"2024-09-21T07:07:30.541185+0000","last_unstale":"2024-09-21T07:07:44.633409+0000","last_undegraded":"2024-09-21T07:07:44.633409+0000","last_fullsized":"2024-09-21T07:07:44.633409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:15.837077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573556+0000","last_change":"2024-09-21T07:07:32.560817+0000","last_active":"2024-09-21T07:07:33.573556+0000","last_peered":"2024-09-21T07:07:33.573556+0000","last_clean":"2024-09-21T07:07:33.573556+0000","last_became_active":"2024-09-21T07:07:32.560269+0000","last_became_peered":"2024-09-21T07:07:32.560269+0000","last_unstale":"2024-09-21T07:07:33.573556+0000","last_undegraded":"2024-09-21T07:07:33.573556+0000","last_fullsized":"2024-09-21T07:07:33.573556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:40.109644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:41.612838+0000","last_change":"2024-09-21T07:07:30.543936+0000","last_active":"2024-09-21T07:07:41.612838+0000","last_peered":"2024-09-21T07:07:41.612838+0000","last_clean":"2024-09-21T07:07:41.612838+0000","last_became_active":"2024-09-21T07:07:30.543530+0000","last_became_peered":"2024-09-21T07:07:30.543530+0000","last_unstale":"2024-09-21T07:07:41.612838+0000","last_undegraded":"2024-09-21T07:07:41.612838+0000","last_fullsized":"2024-09-21T07:07:41.612838+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:02.312471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564094+0000","last_change":"2024-09-21T07:07:32.542182+0000","last_active":"2024-09-21T07:07:33.564094+0000","last_peered":"2024-09-21T07:07:33.564094+0000","last_clean":"2024-09-21T07:07:33.564094+0000","last_became_active":"2024-09-21T07:07:32.541750+0000","last_became_peered":"2024-09-21T07:07:32.541750+0000","last_unstale":"2024-09-21T07:07:33.564094+0000","last_undegraded":"2024-09-21T07:07:33.564094+0000","last_fullsized":"2024-09-21T07:07:33.564094+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.184712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653368+0000","last_change":"2024-09-21T07:07:30.754978+0000","last_active":"2024-09-21T07:07:54.653368+0000","last_peered":"2024-09-21T07:07:54.653368+0000","last_clean":"2024-09-21T07:07:54.653368+0000","last_became_active":"2024-09-21T07:07:30.754149+0000","last_became_peered":"2024-09-21T07:07:30.754149+0000","last_unstale":"2024-09-21T07:07:54.653368+0000","last_undegraded":"2024-09-21T07:07:54.653368+0000","last_fullsized":"2024-09-21T07:07:54.653368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:36.140237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565483+0000","last_change":"2024-09-21T07:07:32.570424+0000","last_active":"2024-09-21T07:07:33.565483+0000","last_peered":"2024-09-21T07:07:33.565483+0000","last_clean":"2024-09-21T07:07:33.565483+0000","last_became_active":"2024-09-21T07:07:32.570029+0000","last_became_peered":"2024-09-21T07:07:32.570029+0000","last_unstale":"2024-09-21T07:07:33.565483+0000","last_undegraded":"2024-09-21T07:07:33.565483+0000","last_fullsized":"2024-09-21T07:07:33.565483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:09.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.652840+0000","last_change":"2024-09-21T07:07:30.543963+0000","last_active":"2024-09-21T07:07:54.652840+0000","last_peered":"2024-09-21T07:07:54.652840+0000","last_clean":"2024-09-21T07:07:54.652840+0000","last_became_active":"2024-09-21T07:07:30.543586+0000","last_became_peered":"2024-09-21T07:07:30.543586+0000","last_unstale":"2024-09-21T07:07:54.652840+0000","last_undegraded":"2024-09-21T07:07:54.652840+0000","last_fullsized":"2024-09-21T07:07:54.652840+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:05.782005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573100+0000","last_change":"2024-09-21T07:07:32.556132+0000","last_active":"2024-09-21T07:07:33.573100+0000","last_peered":"2024-09-21T07:07:33.573100+0000","last_clean":"2024-09-21T07:07:33.573100+0000","last_became_active":"2024-09-21T07:07:32.555717+0000","last_became_peered":"2024-09-21T07:07:32.555717+0000","last_unstale":"2024-09-21T07:07:33.573100+0000","last_undegraded":"2024-09-21T07:07:33.573100+0000","last_fullsized":"2024-09-21T07:07:33.573100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.809268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663009+0000","last_change":"2024-09-21T07:07:30.755143+0000","last_active":"2024-09-21T07:07:56.663009+0000","last_peered":"2024-09-21T07:07:56.663009+0000","last_clean":"2024-09-21T07:07:56.663009+0000","last_became_active":"2024-09-21T07:07:30.754591+0000","last_became_peered":"2024-09-21T07:07:30.754591+0000","last_unstale":"2024-09-21T07:07:56.663009+0000","last_undegraded":"2024-09-21T07:07:56.663009+0000","last_fullsized":"2024-09-21T07:07:56.663009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:13.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:34.035873+0000","last_change":"2024-09-21T07:07:32.552869+0000","last_active":"2024-09-21T07:07:34.035873+0000","last_peered":"2024-09-21T07:07:34.035873+0000","last_clean":"2024-09-21T07:07:34.035873+0000","last_became_active":"2024-09-21T07:07:32.552483+0000","last_became_peered":"2024-09-21T07:07:32.552483+0000","last_unstale":"2024-09-21T07:07:34.035873+0000","last_undegraded":"2024-09-21T07:07:34.035873+0000","last_fullsized":"2024-09-21T07:07:34.035873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:21.006847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.669000+0000","last_change":"2024-09-21T07:07:30.755552+0000","last_active":"2024-09-21T07:07:56.669000+0000","last_peered":"2024-09-21T07:07:56.669000+0000","last_clean":"2024-09-21T07:07:56.669000+0000","last_became_active":"2024-09-21T07:07:30.754451+0000","last_became_peered":"2024-09-21T07:07:30.754451+0000","last_unstale":"2024-09-21T07:07:56.669000+0000","last_undegraded":"2024-09-21T07:07:56.669000+0000","last_fullsized":"2024-09-21T07:07:56.669000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:50.229649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564719+0000","last_change":"2024-09-21T07:07:32.543249+0000","last_active":"2024-09-21T07:07:33.564719+0000","last_peered":"2024-09-21T07:07:33.564719+0000","last_clean":"2024-09-21T07:07:33.564719+0000","last_became_active":"2024-09-21T07:07:32.542866+0000","last_became_peered":"2024-09-21T07:07:32.542866+0000","last_unstale":"2024-09-21T07:07:33.564719+0000","last_undegraded":"2024-09-21T07:07:33.564719+0000","last_fullsized":"2024-09-21T07:07:33.564719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:29.476454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'15","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663256+0000","last_change":"2024-09-21T07:07:30.541589+0000","last_active":"2024-09-21T07:07:56.663256+0000","last_peered":"2024-09-21T07:07:56.663256+0000","last_clean":"2024-09-21T07:07:56.663256+0000","last_became_active":"2024-09-21T07:07:30.541171+0000","last_became_peered":"2024-09-21T07:07:30.541171+0000","last_unstale":"2024-09-21T07:07:56.663256+0000","last_undegraded":"2024-09-21T07:07:56.663256+0000","last_fullsized":"2024-09-21T07:07:56.663256+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:46.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574294+0000","last_change":"2024-09-21T07:07:32.558409+0000","last_active":"2024-09-21T07:07:33.574294+0000","last_peered":"2024-09-21T07:07:33.574294+0000","last_clean":"2024-09-21T07:07:33.574294+0000","last_became_active":"2024-09-21T07:07:32.557886+0000","last_became_peered":"2024-09-21T07:07:32.557886+0000","last_unstale":"2024-09-21T07:07:33.574294+0000","last_undegraded":"2024-09-21T07:07:33.574294+0000","last_fullsized":"2024-09-21T07:07:33.574294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.071651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.628769+0000","last_change":"2024-09-21T07:07:30.536107+0000","last_active":"2024-09-21T07:07:43.628769+0000","last_peered":"2024-09-21T07:07:43.628769+0000","last_clean":"2024-09-21T07:07:43.628769+0000","last_became_active":"2024-09-21T07:07:30.535455+0000","last_became_peered":"2024-09-21T07:07:30.535455+0000","last_unstale":"2024-09-21T07:07:43.628769+0000","last_undegraded":"2024-09-21T07:07:43.628769+0000","last_fullsized":"2024-09-21T07:07:43.628769+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:55.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572308+0000","last_change":"2024-09-21T07:07:32.553187+0000","last_active":"2024-09-21T07:07:33.572308+0000","last_peered":"2024-09-21T07:07:33.572308+0000","last_clean":"2024-09-21T07:07:33.572308+0000","last_became_active":"2024-09-21T07:07:32.552905+0000","last_became_peered":"2024-09-21T07:07:32.552905+0000","last_unstale":"2024-09-21T07:07:33.572308+0000","last_undegraded":"2024-09-21T07:07:33.572308+0000","last_fullsized":"2024-09-21T07:07:33.572308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:24.790329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665358+0000","last_change":"2024-09-21T07:07:30.754858+0000","last_active":"2024-09-21T07:07:56.665358+0000","last_peered":"2024-09-21T07:07:56.665358+0000","last_clean":"2024-09-21T07:07:56.665358+0000","last_became_active":"2024-09-21T07:07:30.754483+0000","last_became_peered":"2024-09-21T07:07:30.754483+0000","last_unstale":"2024-09-21T07:07:56.665358+0000","last_undegraded":"2024-09-21T07:07:56.665358+0000","last_fullsized":"2024-09-21T07:07:56.665358+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:29.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666429+0000","last_change":"2024-09-21T07:07:32.562213+0000","last_active":"2024-09-21T07:07:56.666429+0000","last_peered":"2024-09-21T07:07:56.666429+0000","last_clean":"2024-09-21T07:07:56.666429+0000","last_became_active":"2024-09-21T07:07:32.561834+0000","last_became_peered":"2024-09-21T07:07:32.561834+0000","last_unstale":"2024-09-21T07:07:56.666429+0000","last_undegraded":"2024-09-21T07:07:56.666429+0000","last_fullsized":"2024-09-21T07:07:56.666429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:12.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.627147+0000","last_change":"2024-09-21T07:07:30.543455+0000","last_active":"2024-09-21T07:07:43.627147+0000","last_peered":"2024-09-21T07:07:43.627147+0000","last_clean":"2024-09-21T07:07:43.627147+0000","last_became_active":"2024-09-21T07:07:30.543059+0000","last_became_peered":"2024-09-21T07:07:30.543059+0000","last_unstale":"2024-09-21T07:07:43.627147+0000","last_undegraded":"2024-09-21T07:07:43.627147+0000","last_fullsized":"2024-09-21T07:07:43.627147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.896121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572750+0000","last_change":"2024-09-21T07:07:32.560600+0000","last_active":"2024-09-21T07:07:33.572750+0000","last_peered":"2024-09-21T07:07:33.572750+0000","last_clean":"2024-09-21T07:07:33.572750+0000","last_became_active":"2024-09-21T07:07:32.560159+0000","last_became_peered":"2024-09-21T07:07:32.560159+0000","last_unstale":"2024-09-21T07:07:33.572750+0000","last_undegraded":"2024-09-21T07:07:33.572750+0000","last_fullsized":"2024-09-21T07:07:33.572750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.228180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:42.623393+0000","last_change":"2024-09-21T07:07:30.546099+0000","last_active":"2024-09-21T07:07:42.623393+0000","last_peered":"2024-09-21T07:07:42.623393+0000","last_clean":"2024-09-21T07:07:42.623393+0000","last_became_active":"2024-09-21T07:07:30.545476+0000","last_became_peered":"2024-09-21T07:07:30.545476+0000","last_unstale":"2024-09-21T07:07:42.623393+0000","last_undegraded":"2024-09-21T07:07:42.623393+0000","last_fullsized":"2024-09-21T07:07:42.623393+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:08.001490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573373+0000","last_change":"2024-09-21T07:07:32.554033+0000","last_active":"2024-09-21T07:07:33.573373+0000","last_peered":"2024-09-21T07:07:33.573373+0000","last_clean":"2024-09-21T07:07:33.573373+0000","last_became_active":"2024-09-21T07:07:32.553654+0000","last_became_peered":"2024-09-21T07:07:32.553654+0000","last_unstale":"2024-09-21T07:07:33.573373+0000","last_undegraded":"2024-09-21T07:07:33.573373+0000","last_fullsized":"2024-09-21T07:07:33.573373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:15.876104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666978+0000","last_change":"2024-09-21T07:07:30.547818+0000","last_active":"2024-09-21T07:07:56.666978+0000","last_peered":"2024-09-21T07:07:56.666978+0000","last_clean":"2024-09-21T07:07:56.666978+0000","last_became_active":"2024-09-21T07:07:30.547387+0000","last_became_peered":"2024-09-21T07:07:30.547387+0000","last_unstale":"2024-09-21T07:07:56.666978+0000","last_undegraded":"2024-09-21T07:07:56.666978+0000","last_fullsized":"2024-09-21T07:07:56.666978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572574+0000","last_change":"2024-09-21T07:07:32.566731+0000","last_active":"2024-09-21T07:07:33.572574+0000","last_peered":"2024-09-21T07:07:33.572574+0000","last_clean":"2024-09-21T07:07:33.572574+0000","last_became_active":"2024-09-21T07:07:32.566233+0000","last_became_peered":"2024-09-21T07:07:32.566233+0000","last_unstale":"2024-09-21T07:07:33.572574+0000","last_undegraded":"2024-09-21T07:07:33.572574+0000","last_fullsized":"2024-09-21T07:07:33.572574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:57.630088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565418+0000","last_change":"2024-09-21T07:07:32.570224+0000","last_active":"2024-09-21T07:07:33.565418+0000","last_peered":"2024-09-21T07:07:33.565418+0000","last_clean":"2024-09-21T07:07:33.565418+0000","last_became_active":"2024-09-21T07:07:32.569847+0000","last_became_peered":"2024-09-21T07:07:32.569847+0000","last_unstale":"2024-09-21T07:07:33.565418+0000","last_undegraded":"2024-09-21T07:07:33.565418+0000","last_fullsized":"2024-09-21T07:07:33.565418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:44.565390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.668041+0000","last_change":"2024-09-21T07:07:30.544884+0000","last_active":"2024-09-21T07:07:56.668041+0000","last_peered":"2024-09-21T07:07:56.668041+0000","last_clean":"2024-09-21T07:07:56.668041+0000","last_became_active":"2024-09-21T07:07:30.543321+0000","last_became_peered":"2024-09-21T07:07:30.543321+0000","last_unstale":"2024-09-21T07:07:56.668041+0000","last_undegraded":"2024-09-21T07:07:56.668041+0000","last_fullsized":"2024-09-21T07:07:56.668041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.234905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665654+0000","last_change":"2024-09-21T07:07:32.566124+0000","last_active":"2024-09-21T07:07:56.665654+0000","last_peered":"2024-09-21T07:07:56.665654+0000","last_clean":"2024-09-21T07:07:56.665654+0000","last_became_active":"2024-09-21T07:07:32.565743+0000","last_became_peered":"2024-09-21T07:07:32.565743+0000","last_unstale":"2024-09-21T07:07:56.665654+0000","last_undegraded":"2024-09-21T07:07:56.665654+0000","last_fullsized":"2024-09-21T07:07:56.665654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:57.048529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.669538+0000","last_change":"2024-09-21T07:07:30.546742+0000","last_active":"2024-09-21T07:07:56.669538+0000","last_peered":"2024-09-21T07:07:56.669538+0000","last_clean":"2024-09-21T07:07:56.669538+0000","last_became_active":"2024-09-21T07:07:30.546300+0000","last_became_peered":"2024-09-21T07:07:30.546300+0000","last_unstale":"2024-09-21T07:07:56.669538+0000","last_undegraded":"2024-09-21T07:07:56.669538+0000","last_fullsized":"2024-09-21T07:07:56.669538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:58.903582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574773+0000","last_change":"2024-09-21T07:07:32.565602+0000","last_active":"2024-09-21T07:07:33.574773+0000","last_peered":"2024-09-21T07:07:33.574773+0000","last_clean":"2024-09-21T07:07:33.574773+0000","last_became_active":"2024-09-21T07:07:32.565252+0000","last_became_peered":"2024-09-21T07:07:32.565252+0000","last_unstale":"2024-09-21T07:07:33.574773+0000","last_undegraded":"2024-09-21T07:07:33.574773+0000","last_fullsized":"2024-09-21T07:07:33.574773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:50.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.579859+0000","last_change":"2024-09-21T07:07:30.754535+0000","last_active":"2024-09-21T07:07:33.579859+0000","last_peered":"2024-09-21T07:07:33.579859+0000","last_clean":"2024-09-21T07:07:33.579859+0000","last_became_active":"2024-09-21T07:07:30.754129+0000","last_became_peered":"2024-09-21T07:07:30.754129+0000","last_unstale":"2024-09-21T07:07:33.579859+0000","last_undegraded":"2024-09-21T07:07:33.579859+0000","last_fullsized":"2024-09-21T07:07:33.579859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:23.800713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574580+0000","last_change":"2024-09-21T07:07:32.561210+0000","last_active":"2024-09-21T07:07:33.574580+0000","last_peered":"2024-09-21T07:07:33.574580+0000","last_clean":"2024-09-21T07:07:33.574580+0000","last_became_active":"2024-09-21T07:07:32.560850+0000","last_became_peered":"2024-09-21T07:07:32.560850+0000","last_unstale":"2024-09-21T07:07:33.574580+0000","last_undegraded":"2024-09-21T07:07:33.574580+0000","last_fullsized":"2024-09-21T07:07:33.574580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.212097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663194+0000","last_change":"2024-09-21T07:07:30.543778+0000","last_active":"2024-09-21T07:07:56.663194+0000","last_peered":"2024-09-21T07:07:56.663194+0000","last_clean":"2024-09-21T07:07:56.663194+0000","last_became_active":"2024-09-21T07:07:30.543474+0000","last_became_peered":"2024-09-21T07:07:30.543474+0000","last_unstale":"2024-09-21T07:07:56.663194+0000","last_undegraded":"2024-09-21T07:07:56.663194+0000","last_fullsized":"2024-09-21T07:07:56.663194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:06.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61850,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":154,"num_read_kb":134,"num_write":241,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":185550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":378262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40948,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704204,"statfs":{"total":95995035648,"available":95953104896,"internally_reserved":0,"allocated":1478656,"data_stored":1014494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":386444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":378179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528358,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1413120,"data_stored":971088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":969984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":377343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":872448,"data_stored":441720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40308,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704844,"statfs":{"total":95995035648,"available":95953760256,"internally_reserved":0,"allocated":823296,"data_stored":379248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:07:59.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:07:59.525 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:07:59.916 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:59 smithi029 ceph-mon[30983]: pgmap v306: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-21T07:07:59.916 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:07:59 smithi029 ceph-mon[30983]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:07:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:59 smithi052 ceph-mon[34308]: pgmap v306: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-21T07:07:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:07:59 smithi052 ceph-mon[34308]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.004+0000 7faf94c4a640 1 -- 172.21.15.29:0/3361705085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90103b60 msgr2=0x7faf90103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.004+0000 7faf94c4a640 1 --2- 172.21.15.29:0/3361705085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90103b60 0x7faf90103f70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faf88009ca0 tx=0x7faf8802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.004+0000 7faf94c4a640 1 -- 172.21.15.29:0/3361705085 shutdown_connections 2024-09-21T07:08:00.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.004+0000 7faf94c4a640 1 --2- 172.21.15.29:0/3361705085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf90109df0 0x7faf90110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.004+0000 7faf94c4a640 1 --2- 172.21.15.29:0/3361705085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf901094a0 0x7faf901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.004+0000 7faf94c4a640 1 --2- 172.21.15.29:0/3361705085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90103b60 0x7faf90103f70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.004+0000 7faf94c4a640 1 -- 172.21.15.29:0/3361705085 >> 172.21.15.29:0/3361705085 conn(0x7faf9007b850 msgr2=0x7faf9007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.005+0000 7faf94c4a640 1 -- 172.21.15.29:0/3361705085 shutdown_connections 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.005+0000 7faf94c4a640 1 -- 172.21.15.29:0/3361705085 wait complete. 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.005+0000 7faf94c4a640 1 Processor -- start 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.005+0000 7faf94c4a640 1 -- start start 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf94c4a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf90103b60 0x7faf90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf94c4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf901094a0 0x7faf90075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf94c4a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90109df0 0x7faf90076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf94c4a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7faf90113ab0 con 0x7faf90109df0 2024-09-21T07:08:00.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf94c4a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf90113930 con 0x7faf901094a0 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf94c4a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faf90113c30 con 0x7faf90103b60 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90109df0 0x7faf90076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90109df0 0x7faf90076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50358/0 (socket says 172.21.15.29:50358) 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 -- 172.21.15.29:0/2931091677 learned_addr learned my addr 172.21.15.29:0/2931091677 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8e59c640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf90103b60 0x7faf90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 -- 172.21.15.29:0/2931091677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf90103b60 msgr2=0x7faf90075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8dd9b640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf901094a0 0x7faf90075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf90103b60 0x7faf90075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 -- 172.21.15.29:0/2931091677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf901094a0 msgr2=0x7faf90075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf901094a0 0x7faf90075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 -- 172.21.15.29:0/2931091677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf901a8760 con 0x7faf90109df0 2024-09-21T07:08:00.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf8ed9d640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90109df0 0x7faf90076190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf8000d750 tx=0x7faf8000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf877fe640 1 -- 172.21.15.29:0/2931091677 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80017070 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.006+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf901a8a50 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.007+0000 7faf877fe640 1 -- 172.21.15.29:0/2931091677 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf800054d0 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.007+0000 7faf877fe640 1 -- 172.21.15.29:0/2931091677 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80004c60 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.007+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf901a8f90 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.008+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf90103f70 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.009+0000 7faf877fe640 1 -- 172.21.15.29:0/2931091677 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7faf80009bd0 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.010+0000 7faf877fe640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faf7c0b65a0 0x7faf7c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.010+0000 7faf8e59c640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faf7c0b65a0 0x7faf7c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.010+0000 7faf877fe640 1 -- 172.21.15.29:0/2931091677 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7faf800e72e0 con 0x7faf90109df0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.011+0000 7faf8e59c640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faf7c0b65a0 0x7faf7c0b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faf88004af0 tx=0x7faf88000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:00.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.013+0000 7faf877fe640 1 -- 172.21.15.29:0/2931091677 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf800ada20 con 0x7faf90109df0 2024-09-21T07:08:00.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:59 smithi066 ceph-mon[34793]: pgmap v306: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-21T07:08:00.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:07:59 smithi066 ceph-mon[34793]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:00.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.197+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf90063800 con 0x7faf7c0b65a0 2024-09-21T07:08:00.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.202+0000 7faf877fe640 1 -- 172.21.15.29:0/2931091677 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258695 (secure 0 0 0) 0x7faf90063800 con 0x7faf7c0b65a0 2024-09-21T07:08:00.207 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:00.207 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faf7c0b65a0 msgr2=0x7faf7c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faf7c0b65a0 0x7faf7c0b8ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faf88004af0 tx=0x7faf88000f40 comp rx=0 tx=0).stop 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90109df0 msgr2=0x7faf90076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90109df0 0x7faf90076190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faf8000d750 tx=0x7faf8000dc10 comp rx=0 tx=0).stop 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 shutdown_connections 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faf7c0b65a0 0x7faf7c0b8ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf90109df0 0x7faf90076190 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf901094a0 0x7faf90075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 --2- 172.21.15.29:0/2931091677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf90103b60 0x7faf90075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:00.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 >> 172.21.15.29:0/2931091677 conn(0x7faf9007b850 msgr2=0x7faf90107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:00.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 shutdown_connections 2024-09-21T07:08:00.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:00.206+0000 7faf94c4a640 1 -- 172.21.15.29:0/2931091677 wait complete. 2024-09-21T07:08:00.954 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-21T07:07:59.998026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660966,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":367,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385796,"kb_used_data":11560,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556028,"statfs":{"total":1151940427776,"available":1151545372672,"internally_reserved":0,"allocated":11837440,"data_stored":6537659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33754,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":23,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002197"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665830+0000","last_change":"2024-09-21T07:07:32.566786+0000","last_active":"2024-09-21T07:07:57.665830+0000","last_peered":"2024-09-21T07:07:57.665830+0000","last_clean":"2024-09-21T07:07:57.665830+0000","last_became_active":"2024-09-21T07:07:32.565722+0000","last_became_peered":"2024-09-21T07:07:32.565722+0000","last_unstale":"2024-09-21T07:07:57.665830+0000","last_undegraded":"2024-09-21T07:07:57.665830+0000","last_fullsized":"2024-09-21T07:07:57.665830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:22.389773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574477+0000","last_change":"2024-09-21T07:07:32.556460+0000","last_active":"2024-09-21T07:07:33.574477+0000","last_peered":"2024-09-21T07:07:33.574477+0000","last_clean":"2024-09-21T07:07:33.574477+0000","last_became_active":"2024-09-21T07:07:32.555738+0000","last_became_peered":"2024-09-21T07:07:32.555738+0000","last_unstale":"2024-09-21T07:07:33.574477+0000","last_undegraded":"2024-09-21T07:07:33.574477+0000","last_fullsized":"2024-09-21T07:07:33.574477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.921413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572563+0000","last_change":"2024-09-21T07:07:32.565814+0000","last_active":"2024-09-21T07:07:33.572563+0000","last_peered":"2024-09-21T07:07:33.572563+0000","last_clean":"2024-09-21T07:07:33.572563+0000","last_became_active":"2024-09-21T07:07:32.565401+0000","last_became_peered":"2024-09-21T07:07:32.565401+0000","last_unstale":"2024-09-21T07:07:33.572563+0000","last_undegraded":"2024-09-21T07:07:33.572563+0000","last_fullsized":"2024-09-21T07:07:33.572563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:56.705903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565506+0000","last_change":"2024-09-21T07:07:32.554713+0000","last_active":"2024-09-21T07:07:33.565506+0000","last_peered":"2024-09-21T07:07:33.565506+0000","last_clean":"2024-09-21T07:07:33.565506+0000","last_became_active":"2024-09-21T07:07:32.554203+0000","last_became_peered":"2024-09-21T07:07:32.554203+0000","last_unstale":"2024-09-21T07:07:33.565506+0000","last_undegraded":"2024-09-21T07:07:33.565506+0000","last_fullsized":"2024-09-21T07:07:33.565506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:29.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666797+0000","last_change":"2024-09-21T07:07:32.566048+0000","last_active":"2024-09-21T07:07:56.666797+0000","last_peered":"2024-09-21T07:07:56.666797+0000","last_clean":"2024-09-21T07:07:56.666797+0000","last_became_active":"2024-09-21T07:07:32.565659+0000","last_became_peered":"2024-09-21T07:07:32.565659+0000","last_unstale":"2024-09-21T07:07:56.666797+0000","last_undegraded":"2024-09-21T07:07:56.666797+0000","last_fullsized":"2024-09-21T07:07:56.666797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:56.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662196+0000","last_change":"2024-09-21T07:07:32.550492+0000","last_active":"2024-09-21T07:07:57.662196+0000","last_peered":"2024-09-21T07:07:57.662196+0000","last_clean":"2024-09-21T07:07:57.662196+0000","last_became_active":"2024-09-21T07:07:32.549691+0000","last_became_peered":"2024-09-21T07:07:32.549691+0000","last_unstale":"2024-09-21T07:07:57.662196+0000","last_undegraded":"2024-09-21T07:07:57.662196+0000","last_fullsized":"2024-09-21T07:07:57.662196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.890164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572221+0000","last_change":"2024-09-21T07:07:32.560258+0000","last_active":"2024-09-21T07:07:33.572221+0000","last_peered":"2024-09-21T07:07:33.572221+0000","last_clean":"2024-09-21T07:07:33.572221+0000","last_became_active":"2024-09-21T07:07:32.559890+0000","last_became_peered":"2024-09-21T07:07:32.559890+0000","last_unstale":"2024-09-21T07:07:33.572221+0000","last_undegraded":"2024-09-21T07:07:33.572221+0000","last_fullsized":"2024-09-21T07:07:33.572221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.794736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573718+0000","last_change":"2024-09-21T07:07:32.560923+0000","last_active":"2024-09-21T07:07:33.573718+0000","last_peered":"2024-09-21T07:07:33.573718+0000","last_clean":"2024-09-21T07:07:33.573718+0000","last_became_active":"2024-09-21T07:07:32.560509+0000","last_became_peered":"2024-09-21T07:07:32.560509+0000","last_unstale":"2024-09-21T07:07:33.573718+0000","last_undegraded":"2024-09-21T07:07:33.573718+0000","last_fullsized":"2024-09-21T07:07:33.573718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:59.576434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.664977+0000","last_change":"2024-09-21T07:07:32.564475+0000","last_active":"2024-09-21T07:07:56.664977+0000","last_peered":"2024-09-21T07:07:56.664977+0000","last_clean":"2024-09-21T07:07:56.664977+0000","last_became_active":"2024-09-21T07:07:32.564115+0000","last_became_peered":"2024-09-21T07:07:32.564115+0000","last_unstale":"2024-09-21T07:07:56.664977+0000","last_undegraded":"2024-09-21T07:07:56.664977+0000","last_fullsized":"2024-09-21T07:07:56.664977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:03.989109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662889+0000","last_change":"2024-09-21T07:07:32.557377+0000","last_active":"2024-09-21T07:07:57.662889+0000","last_peered":"2024-09-21T07:07:57.662889+0000","last_clean":"2024-09-21T07:07:57.662889+0000","last_became_active":"2024-09-21T07:07:32.556732+0000","last_became_peered":"2024-09-21T07:07:32.556732+0000","last_unstale":"2024-09-21T07:07:57.662889+0000","last_undegraded":"2024-09-21T07:07:57.662889+0000","last_fullsized":"2024-09-21T07:07:57.662889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:32.474690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574804+0000","last_change":"2024-09-21T07:07:32.558691+0000","last_active":"2024-09-21T07:07:33.574804+0000","last_peered":"2024-09-21T07:07:33.574804+0000","last_clean":"2024-09-21T07:07:33.574804+0000","last_became_active":"2024-09-21T07:07:32.558029+0000","last_became_peered":"2024-09-21T07:07:32.558029+0000","last_unstale":"2024-09-21T07:07:33.574804+0000","last_undegraded":"2024-09-21T07:07:33.574804+0000","last_fullsized":"2024-09-21T07:07:33.574804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.378786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565633+0000","last_change":"2024-09-21T07:07:32.556500+0000","last_active":"2024-09-21T07:07:33.565633+0000","last_peered":"2024-09-21T07:07:33.565633+0000","last_clean":"2024-09-21T07:07:33.565633+0000","last_became_active":"2024-09-21T07:07:32.555529+0000","last_became_peered":"2024-09-21T07:07:32.555529+0000","last_unstale":"2024-09-21T07:07:33.565633+0000","last_undegraded":"2024-09-21T07:07:33.565633+0000","last_fullsized":"2024-09-21T07:07:33.565633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.494498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564386+0000","last_change":"2024-09-21T07:07:32.560235+0000","last_active":"2024-09-21T07:07:33.564386+0000","last_peered":"2024-09-21T07:07:33.564386+0000","last_clean":"2024-09-21T07:07:33.564386+0000","last_became_active":"2024-09-21T07:07:32.559834+0000","last_became_peered":"2024-09-21T07:07:32.559834+0000","last_unstale":"2024-09-21T07:07:33.564386+0000","last_undegraded":"2024-09-21T07:07:33.564386+0000","last_fullsized":"2024-09-21T07:07:33.564386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:30.090878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572860+0000","last_change":"2024-09-21T07:07:32.554158+0000","last_active":"2024-09-21T07:07:33.572860+0000","last_peered":"2024-09-21T07:07:33.572860+0000","last_clean":"2024-09-21T07:07:33.572860+0000","last_became_active":"2024-09-21T07:07:32.553837+0000","last_became_peered":"2024-09-21T07:07:32.553837+0000","last_unstale":"2024-09-21T07:07:33.572860+0000","last_undegraded":"2024-09-21T07:07:33.572860+0000","last_fullsized":"2024-09-21T07:07:33.572860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:23.845629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572280+0000","last_change":"2024-09-21T07:07:32.556921+0000","last_active":"2024-09-21T07:07:33.572280+0000","last_peered":"2024-09-21T07:07:33.572280+0000","last_clean":"2024-09-21T07:07:33.572280+0000","last_became_active":"2024-09-21T07:07:32.556529+0000","last_became_peered":"2024-09-21T07:07:32.556529+0000","last_unstale":"2024-09-21T07:07:33.572280+0000","last_undegraded":"2024-09-21T07:07:33.572280+0000","last_fullsized":"2024-09-21T07:07:33.572280+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.447617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665137+0000","last_change":"2024-09-21T07:07:32.567572+0000","last_active":"2024-09-21T07:07:56.665137+0000","last_peered":"2024-09-21T07:07:56.665137+0000","last_clean":"2024-09-21T07:07:56.665137+0000","last_became_active":"2024-09-21T07:07:32.567159+0000","last_became_peered":"2024-09-21T07:07:32.567159+0000","last_unstale":"2024-09-21T07:07:56.665137+0000","last_undegraded":"2024-09-21T07:07:56.665137+0000","last_fullsized":"2024-09-21T07:07:56.665137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.316539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665990+0000","last_change":"2024-09-21T07:07:32.567213+0000","last_active":"2024-09-21T07:07:57.665990+0000","last_peered":"2024-09-21T07:07:57.665990+0000","last_clean":"2024-09-21T07:07:57.665990+0000","last_became_active":"2024-09-21T07:07:32.566284+0000","last_became_peered":"2024-09-21T07:07:32.566284+0000","last_unstale":"2024-09-21T07:07:57.665990+0000","last_undegraded":"2024-09-21T07:07:57.665990+0000","last_fullsized":"2024-09-21T07:07:57.665990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663157+0000","last_change":"2024-09-21T07:07:32.551695+0000","last_active":"2024-09-21T07:07:56.663157+0000","last_peered":"2024-09-21T07:07:56.663157+0000","last_clean":"2024-09-21T07:07:56.663157+0000","last_became_active":"2024-09-21T07:07:32.551282+0000","last_became_peered":"2024-09-21T07:07:32.551282+0000","last_unstale":"2024-09-21T07:07:56.663157+0000","last_undegraded":"2024-09-21T07:07:56.663157+0000","last_fullsized":"2024-09-21T07:07:56.663157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:33.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669799+0000","last_change":"2024-09-21T07:07:32.551000+0000","last_active":"2024-09-21T07:07:57.669799+0000","last_peered":"2024-09-21T07:07:57.669799+0000","last_clean":"2024-09-21T07:07:57.669799+0000","last_became_active":"2024-09-21T07:07:32.550590+0000","last_became_peered":"2024-09-21T07:07:32.550590+0000","last_unstale":"2024-09-21T07:07:57.669799+0000","last_undegraded":"2024-09-21T07:07:57.669799+0000","last_fullsized":"2024-09-21T07:07:57.669799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:30.213470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668399+0000","last_change":"2024-09-21T07:07:57.668284+0000","last_active":"2024-09-21T07:07:57.668399+0000","last_peered":"2024-09-21T07:07:57.668399+0000","last_clean":"2024-09-21T07:07:57.668399+0000","last_became_active":"2024-09-21T07:07:57.667145+0000","last_became_peered":"2024-09-21T07:07:57.667145+0000","last_unstale":"2024-09-21T07:07:57.668399+0000","last_undegraded":"2024-09-21T07:07:57.668399+0000","last_fullsized":"2024-09-21T07:07:57.668399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:11.662321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564501+0000","last_change":"2024-09-21T07:07:32.555752+0000","last_active":"2024-09-21T07:07:33.564501+0000","last_peered":"2024-09-21T07:07:33.564501+0000","last_clean":"2024-09-21T07:07:33.564501+0000","last_became_active":"2024-09-21T07:07:32.555057+0000","last_became_peered":"2024-09-21T07:07:32.555057+0000","last_unstale":"2024-09-21T07:07:33.564501+0000","last_undegraded":"2024-09-21T07:07:33.564501+0000","last_fullsized":"2024-09-21T07:07:33.564501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:03.161990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666031+0000","last_change":"2024-09-21T07:07:32.555589+0000","last_active":"2024-09-21T07:07:56.666031+0000","last_peered":"2024-09-21T07:07:56.666031+0000","last_clean":"2024-09-21T07:07:56.666031+0000","last_became_active":"2024-09-21T07:07:32.555037+0000","last_became_peered":"2024-09-21T07:07:32.555037+0000","last_unstale":"2024-09-21T07:07:56.666031+0000","last_undegraded":"2024-09-21T07:07:56.666031+0000","last_fullsized":"2024-09-21T07:07:56.666031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:25.346546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573881+0000","last_change":"2024-09-21T07:07:32.559407+0000","last_active":"2024-09-21T07:07:33.573881+0000","last_peered":"2024-09-21T07:07:33.573881+0000","last_clean":"2024-09-21T07:07:33.573881+0000","last_became_active":"2024-09-21T07:07:32.559112+0000","last_became_peered":"2024-09-21T07:07:32.559112+0000","last_unstale":"2024-09-21T07:07:33.573881+0000","last_undegraded":"2024-09-21T07:07:33.573881+0000","last_fullsized":"2024-09-21T07:07:33.573881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:13.970511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564994+0000","last_change":"2024-09-21T07:07:32.564798+0000","last_active":"2024-09-21T07:07:33.564994+0000","last_peered":"2024-09-21T07:07:33.564994+0000","last_clean":"2024-09-21T07:07:33.564994+0000","last_became_active":"2024-09-21T07:07:32.564381+0000","last_became_peered":"2024-09-21T07:07:32.564381+0000","last_unstale":"2024-09-21T07:07:33.564994+0000","last_undegraded":"2024-09-21T07:07:33.564994+0000","last_fullsized":"2024-09-21T07:07:33.564994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:19.667252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574263+0000","last_change":"2024-09-21T07:07:32.555274+0000","last_active":"2024-09-21T07:07:33.574263+0000","last_peered":"2024-09-21T07:07:33.574263+0000","last_clean":"2024-09-21T07:07:33.574263+0000","last_became_active":"2024-09-21T07:07:32.554816+0000","last_became_peered":"2024-09-21T07:07:32.554816+0000","last_unstale":"2024-09-21T07:07:33.574263+0000","last_undegraded":"2024-09-21T07:07:33.574263+0000","last_fullsized":"2024-09-21T07:07:33.574263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.018974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.671064+0000","last_change":"2024-09-21T07:07:32.555655+0000","last_active":"2024-09-21T07:07:57.671064+0000","last_peered":"2024-09-21T07:07:57.671064+0000","last_clean":"2024-09-21T07:07:57.671064+0000","last_became_active":"2024-09-21T07:07:32.555240+0000","last_became_peered":"2024-09-21T07:07:32.555240+0000","last_unstale":"2024-09-21T07:07:57.671064+0000","last_undegraded":"2024-09-21T07:07:57.671064+0000","last_fullsized":"2024-09-21T07:07:57.671064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:51.550091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664496+0000","last_change":"2024-09-21T07:07:32.570761+0000","last_active":"2024-09-21T07:07:57.664496+0000","last_peered":"2024-09-21T07:07:57.664496+0000","last_clean":"2024-09-21T07:07:57.664496+0000","last_became_active":"2024-09-21T07:07:32.569555+0000","last_became_peered":"2024-09-21T07:07:32.569555+0000","last_unstale":"2024-09-21T07:07:57.664496+0000","last_undegraded":"2024-09-21T07:07:57.664496+0000","last_fullsized":"2024-09-21T07:07:57.664496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:23.414096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564554+0000","last_change":"2024-09-21T07:07:32.548955+0000","last_active":"2024-09-21T07:07:33.564554+0000","last_peered":"2024-09-21T07:07:33.564554+0000","last_clean":"2024-09-21T07:07:33.564554+0000","last_became_active":"2024-09-21T07:07:32.548562+0000","last_became_peered":"2024-09-21T07:07:32.548562+0000","last_unstale":"2024-09-21T07:07:33.564554+0000","last_undegraded":"2024-09-21T07:07:33.564554+0000","last_fullsized":"2024-09-21T07:07:33.564554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:24.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572567+0000","last_change":"2024-09-21T07:07:32.550889+0000","last_active":"2024-09-21T07:07:33.572567+0000","last_peered":"2024-09-21T07:07:33.572567+0000","last_clean":"2024-09-21T07:07:33.572567+0000","last_became_active":"2024-09-21T07:07:32.550559+0000","last_became_peered":"2024-09-21T07:07:32.550559+0000","last_unstale":"2024-09-21T07:07:33.572567+0000","last_undegraded":"2024-09-21T07:07:33.572567+0000","last_fullsized":"2024-09-21T07:07:33.572567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:35.575626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669528+0000","last_change":"2024-09-21T07:07:32.552019+0000","last_active":"2024-09-21T07:07:57.669528+0000","last_peered":"2024-09-21T07:07:57.669528+0000","last_clean":"2024-09-21T07:07:57.669528+0000","last_became_active":"2024-09-21T07:07:32.551562+0000","last_became_peered":"2024-09-21T07:07:32.551562+0000","last_unstale":"2024-09-21T07:07:57.669528+0000","last_undegraded":"2024-09-21T07:07:57.669528+0000","last_fullsized":"2024-09-21T07:07:57.669528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:25.932560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669832+0000","last_change":"2024-09-21T07:07:32.556938+0000","last_active":"2024-09-21T07:07:57.669832+0000","last_peered":"2024-09-21T07:07:57.669832+0000","last_clean":"2024-09-21T07:07:57.669832+0000","last_became_active":"2024-09-21T07:07:32.556331+0000","last_became_peered":"2024-09-21T07:07:32.556331+0000","last_unstale":"2024-09-21T07:07:57.669832+0000","last_undegraded":"2024-09-21T07:07:57.669832+0000","last_fullsized":"2024-09-21T07:07:57.669832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.358076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664137+0000","last_change":"2024-09-21T07:07:32.561984+0000","last_active":"2024-09-21T07:07:57.664137+0000","last_peered":"2024-09-21T07:07:57.664137+0000","last_clean":"2024-09-21T07:07:57.664137+0000","last_became_active":"2024-09-21T07:07:32.561227+0000","last_became_peered":"2024-09-21T07:07:32.561227+0000","last_unstale":"2024-09-21T07:07:57.664137+0000","last_undegraded":"2024-09-21T07:07:57.664137+0000","last_fullsized":"2024-09-21T07:07:57.664137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:35.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.667130+0000","last_change":"2024-09-21T07:07:32.567454+0000","last_active":"2024-09-21T07:07:56.667130+0000","last_peered":"2024-09-21T07:07:56.667130+0000","last_clean":"2024-09-21T07:07:56.667130+0000","last_became_active":"2024-09-21T07:07:32.567063+0000","last_became_peered":"2024-09-21T07:07:32.567063+0000","last_unstale":"2024-09-21T07:07:56.667130+0000","last_undegraded":"2024-09-21T07:07:56.667130+0000","last_fullsized":"2024-09-21T07:07:56.667130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.466771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653759+0000","last_change":"2024-09-21T07:07:30.548785+0000","last_active":"2024-09-21T07:07:54.653759+0000","last_peered":"2024-09-21T07:07:54.653759+0000","last_clean":"2024-09-21T07:07:54.653759+0000","last_became_active":"2024-09-21T07:07:30.547764+0000","last_became_peered":"2024-09-21T07:07:30.547764+0000","last_unstale":"2024-09-21T07:07:54.653759+0000","last_undegraded":"2024-09-21T07:07:54.653759+0000","last_fullsized":"2024-09-21T07:07:54.653759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:18.115002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":74,"state":"peering","last_fresh":"2024-09-21T07:07:32.545905+0000","last_change":"2024-09-21T07:07:57.652924+0000","last_active":"2024-09-21T07:07:31.529868+0000","last_peered":"2024-09-21T07:07:31.529868+0000","last_clean":"2024-09-21T07:07:31.529868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:07:32.545905+0000","last_undegraded":"2024-09-21T07:07:32.545905+0000","last_fullsized":"2024-09-21T07:07:32.545905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.686559+0000","last_change":"2024-09-21T07:07:57.686466+0000","last_active":"2024-09-21T07:07:57.686559+0000","last_peered":"2024-09-21T07:07:57.686559+0000","last_clean":"2024-09-21T07:07:57.686559+0000","last_became_active":"2024-09-21T07:07:57.671977+0000","last_became_peered":"2024-09-21T07:07:57.671977+0000","last_unstale":"2024-09-21T07:07:57.686559+0000","last_undegraded":"2024-09-21T07:07:57.686559+0000","last_fullsized":"2024-09-21T07:07:57.686559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:26.134854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:41.612579+0000","last_change":"2024-09-21T07:07:30.539941+0000","last_active":"2024-09-21T07:07:41.612579+0000","last_peered":"2024-09-21T07:07:41.612579+0000","last_clean":"2024-09-21T07:07:41.612579+0000","last_became_active":"2024-09-21T07:07:30.539401+0000","last_became_peered":"2024-09-21T07:07:30.539401+0000","last_unstale":"2024-09-21T07:07:41.612579+0000","last_undegraded":"2024-09-21T07:07:41.612579+0000","last_fullsized":"2024-09-21T07:07:41.612579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:15.184453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573819+0000","last_change":"2024-09-21T07:07:32.556958+0000","last_active":"2024-09-21T07:07:33.573819+0000","last_peered":"2024-09-21T07:07:33.573819+0000","last_clean":"2024-09-21T07:07:33.573819+0000","last_became_active":"2024-09-21T07:07:32.556581+0000","last_became_peered":"2024-09-21T07:07:32.556581+0000","last_unstale":"2024-09-21T07:07:33.573819+0000","last_undegraded":"2024-09-21T07:07:33.573819+0000","last_fullsized":"2024-09-21T07:07:33.573819+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:57.618263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.630774+0000","last_change":"2024-09-21T07:07:30.547760+0000","last_active":"2024-09-21T07:07:43.630774+0000","last_peered":"2024-09-21T07:07:43.630774+0000","last_clean":"2024-09-21T07:07:43.630774+0000","last_became_active":"2024-09-21T07:07:30.547327+0000","last_became_peered":"2024-09-21T07:07:30.547327+0000","last_unstale":"2024-09-21T07:07:43.630774+0000","last_undegraded":"2024-09-21T07:07:43.630774+0000","last_fullsized":"2024-09-21T07:07:43.630774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:01.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.662668+0000","last_change":"2024-09-21T07:07:32.552691+0000","last_active":"2024-09-21T07:07:56.662668+0000","last_peered":"2024-09-21T07:07:56.662668+0000","last_clean":"2024-09-21T07:07:56.662668+0000","last_became_active":"2024-09-21T07:07:32.552321+0000","last_became_peered":"2024-09-21T07:07:32.552321+0000","last_unstale":"2024-09-21T07:07:56.662668+0000","last_undegraded":"2024-09-21T07:07:56.662668+0000","last_fullsized":"2024-09-21T07:07:56.662668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:56.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:58.658342+0000","last_change":"2024-09-21T07:07:30.545281+0000","last_active":"2024-09-21T07:07:58.658342+0000","last_peered":"2024-09-21T07:07:58.658342+0000","last_clean":"2024-09-21T07:07:58.658342+0000","last_became_active":"2024-09-21T07:07:30.544823+0000","last_became_peered":"2024-09-21T07:07:30.544823+0000","last_unstale":"2024-09-21T07:07:58.658342+0000","last_undegraded":"2024-09-21T07:07:58.658342+0000","last_fullsized":"2024-09-21T07:07:58.658342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.659421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.664484+0000","last_change":"2024-09-21T07:07:32.567833+0000","last_active":"2024-09-21T07:07:56.664484+0000","last_peered":"2024-09-21T07:07:56.664484+0000","last_clean":"2024-09-21T07:07:56.664484+0000","last_became_active":"2024-09-21T07:07:32.566902+0000","last_became_peered":"2024-09-21T07:07:32.566902+0000","last_unstale":"2024-09-21T07:07:56.664484+0000","last_undegraded":"2024-09-21T07:07:56.664484+0000","last_fullsized":"2024-09-21T07:07:56.664484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.871038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.628135+0000","last_change":"2024-09-21T07:07:30.546031+0000","last_active":"2024-09-21T07:07:43.628135+0000","last_peered":"2024-09-21T07:07:43.628135+0000","last_clean":"2024-09-21T07:07:43.628135+0000","last_became_active":"2024-09-21T07:07:30.545658+0000","last_became_peered":"2024-09-21T07:07:30.545658+0000","last_unstale":"2024-09-21T07:07:43.628135+0000","last_undegraded":"2024-09-21T07:07:43.628135+0000","last_fullsized":"2024-09-21T07:07:43.628135+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:20.359374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574873+0000","last_change":"2024-09-21T07:07:32.561445+0000","last_active":"2024-09-21T07:07:33.574873+0000","last_peered":"2024-09-21T07:07:33.574873+0000","last_clean":"2024-09-21T07:07:33.574873+0000","last_became_active":"2024-09-21T07:07:32.561033+0000","last_became_peered":"2024-09-21T07:07:32.561033+0000","last_unstale":"2024-09-21T07:07:33.574873+0000","last_undegraded":"2024-09-21T07:07:33.574873+0000","last_fullsized":"2024-09-21T07:07:33.574873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:30.261234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:42.621920+0000","last_change":"2024-09-21T07:07:30.755110+0000","last_active":"2024-09-21T07:07:42.621920+0000","last_peered":"2024-09-21T07:07:42.621920+0000","last_clean":"2024-09-21T07:07:42.621920+0000","last_became_active":"2024-09-21T07:07:30.754680+0000","last_became_peered":"2024-09-21T07:07:30.754680+0000","last_unstale":"2024-09-21T07:07:42.621920+0000","last_undegraded":"2024-09-21T07:07:42.621920+0000","last_fullsized":"2024-09-21T07:07:42.621920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.202010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665839+0000","last_change":"2024-09-21T07:07:32.557349+0000","last_active":"2024-09-21T07:07:56.665839+0000","last_peered":"2024-09-21T07:07:56.665839+0000","last_clean":"2024-09-21T07:07:56.665839+0000","last_became_active":"2024-09-21T07:07:32.554342+0000","last_became_peered":"2024-09-21T07:07:32.554342+0000","last_unstale":"2024-09-21T07:07:56.665839+0000","last_undegraded":"2024-09-21T07:07:56.665839+0000","last_fullsized":"2024-09-21T07:07:56.665839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:21.356410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:58.661721+0000","last_change":"2024-09-21T07:07:30.547691+0000","last_active":"2024-09-21T07:07:58.661721+0000","last_peered":"2024-09-21T07:07:58.661721+0000","last_clean":"2024-09-21T07:07:58.661721+0000","last_became_active":"2024-09-21T07:07:30.547280+0000","last_became_peered":"2024-09-21T07:07:30.547280+0000","last_unstale":"2024-09-21T07:07:58.661721+0000","last_undegraded":"2024-09-21T07:07:58.661721+0000","last_fullsized":"2024-09-21T07:07:58.661721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:24.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62769,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":70,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.668576+0000","last_change":"2024-09-21T07:07:32.569291+0000","last_active":"2024-09-21T07:07:56.668576+0000","last_peered":"2024-09-21T07:07:56.668576+0000","last_clean":"2024-09-21T07:07:56.668576+0000","last_became_active":"2024-09-21T07:07:32.568503+0000","last_became_peered":"2024-09-21T07:07:32.568503+0000","last_unstale":"2024-09-21T07:07:56.668576+0000","last_undegraded":"2024-09-21T07:07:56.668576+0000","last_fullsized":"2024-09-21T07:07:56.668576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:56.184795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669620+0000","last_change":"2024-09-21T07:07:30.546624+0000","last_active":"2024-09-21T07:07:57.669620+0000","last_peered":"2024-09-21T07:07:57.669620+0000","last_clean":"2024-09-21T07:07:57.669620+0000","last_became_active":"2024-09-21T07:07:30.545497+0000","last_became_peered":"2024-09-21T07:07:30.545497+0000","last_unstale":"2024-09-21T07:07:57.669620+0000","last_undegraded":"2024-09-21T07:07:57.669620+0000","last_fullsized":"2024-09-21T07:07:57.669620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.963089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564151+0000","last_change":"2024-09-21T07:07:32.551123+0000","last_active":"2024-09-21T07:07:33.564151+0000","last_peered":"2024-09-21T07:07:33.564151+0000","last_clean":"2024-09-21T07:07:33.564151+0000","last_became_active":"2024-09-21T07:07:32.550423+0000","last_became_peered":"2024-09-21T07:07:32.550423+0000","last_unstale":"2024-09-21T07:07:33.564151+0000","last_undegraded":"2024-09-21T07:07:33.564151+0000","last_fullsized":"2024-09-21T07:07:33.564151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:00.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.630375+0000","last_change":"2024-09-21T07:07:30.550102+0000","last_active":"2024-09-21T07:07:43.630375+0000","last_peered":"2024-09-21T07:07:43.630375+0000","last_clean":"2024-09-21T07:07:43.630375+0000","last_became_active":"2024-09-21T07:07:30.549609+0000","last_became_peered":"2024-09-21T07:07:30.549609+0000","last_unstale":"2024-09-21T07:07:43.630375+0000","last_undegraded":"2024-09-21T07:07:43.630375+0000","last_fullsized":"2024-09-21T07:07:43.630375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:58.587612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573964+0000","last_change":"2024-09-21T07:07:32.556167+0000","last_active":"2024-09-21T07:07:33.573964+0000","last_peered":"2024-09-21T07:07:33.573964+0000","last_clean":"2024-09-21T07:07:33.573964+0000","last_became_active":"2024-09-21T07:07:32.555372+0000","last_became_peered":"2024-09-21T07:07:32.555372+0000","last_unstale":"2024-09-21T07:07:33.573964+0000","last_undegraded":"2024-09-21T07:07:33.573964+0000","last_fullsized":"2024-09-21T07:07:33.573964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:35.056919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653941+0000","last_change":"2024-09-21T07:07:30.543196+0000","last_active":"2024-09-21T07:07:54.653941+0000","last_peered":"2024-09-21T07:07:54.653941+0000","last_clean":"2024-09-21T07:07:54.653941+0000","last_became_active":"2024-09-21T07:07:30.542755+0000","last_became_peered":"2024-09-21T07:07:30.542755+0000","last_unstale":"2024-09-21T07:07:54.653941+0000","last_undegraded":"2024-09-21T07:07:54.653941+0000","last_fullsized":"2024-09-21T07:07:54.653941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:14.821703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572622+0000","last_change":"2024-09-21T07:07:32.561243+0000","last_active":"2024-09-21T07:07:33.572622+0000","last_peered":"2024-09-21T07:07:33.572622+0000","last_clean":"2024-09-21T07:07:33.572622+0000","last_became_active":"2024-09-21T07:07:32.560878+0000","last_became_peered":"2024-09-21T07:07:32.560878+0000","last_unstale":"2024-09-21T07:07:33.572622+0000","last_undegraded":"2024-09-21T07:07:33.572622+0000","last_fullsized":"2024-09-21T07:07:33.572622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:19.342422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666167+0000","last_change":"2024-09-21T07:07:30.754985+0000","last_active":"2024-09-21T07:07:56.666167+0000","last_peered":"2024-09-21T07:07:56.666167+0000","last_clean":"2024-09-21T07:07:56.666167+0000","last_became_active":"2024-09-21T07:07:30.754490+0000","last_became_peered":"2024-09-21T07:07:30.754490+0000","last_unstale":"2024-09-21T07:07:56.666167+0000","last_undegraded":"2024-09-21T07:07:56.666167+0000","last_fullsized":"2024-09-21T07:07:56.666167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:21.645643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565523+0000","last_change":"2024-09-21T07:07:32.567997+0000","last_active":"2024-09-21T07:07:33.565523+0000","last_peered":"2024-09-21T07:07:33.565523+0000","last_clean":"2024-09-21T07:07:33.565523+0000","last_became_active":"2024-09-21T07:07:32.567314+0000","last_became_peered":"2024-09-21T07:07:32.567314+0000","last_unstale":"2024-09-21T07:07:33.565523+0000","last_undegraded":"2024-09-21T07:07:33.565523+0000","last_fullsized":"2024-09-21T07:07:33.565523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:07.741967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.678889+0000","last_change":"2024-09-21T07:07:57.678175+0000","last_active":"2024-09-21T07:07:57.678889+0000","last_peered":"2024-09-21T07:07:57.678889+0000","last_clean":"2024-09-21T07:07:57.678889+0000","last_became_active":"2024-09-21T07:07:57.671137+0000","last_became_peered":"2024-09-21T07:07:57.671137+0000","last_unstale":"2024-09-21T07:07:57.678889+0000","last_undegraded":"2024-09-21T07:07:57.678889+0000","last_fullsized":"2024-09-21T07:07:57.678889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664423+0000","last_change":"2024-09-21T07:07:32.563380+0000","last_active":"2024-09-21T07:07:57.664423+0000","last_peered":"2024-09-21T07:07:57.664423+0000","last_clean":"2024-09-21T07:07:57.664423+0000","last_became_active":"2024-09-21T07:07:32.563012+0000","last_became_peered":"2024-09-21T07:07:32.563012+0000","last_unstale":"2024-09-21T07:07:57.664423+0000","last_undegraded":"2024-09-21T07:07:57.664423+0000","last_fullsized":"2024-09-21T07:07:57.664423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.627703+0000","last_change":"2024-09-21T07:07:30.546448+0000","last_active":"2024-09-21T07:07:43.627703+0000","last_peered":"2024-09-21T07:07:43.627703+0000","last_clean":"2024-09-21T07:07:43.627703+0000","last_became_active":"2024-09-21T07:07:30.546015+0000","last_became_peered":"2024-09-21T07:07:30.546015+0000","last_unstale":"2024-09-21T07:07:43.627703+0000","last_undegraded":"2024-09-21T07:07:43.627703+0000","last_fullsized":"2024-09-21T07:07:43.627703+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:23.041651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572538+0000","last_change":"2024-09-21T07:07:32.562533+0000","last_active":"2024-09-21T07:07:33.572538+0000","last_peered":"2024-09-21T07:07:33.572538+0000","last_clean":"2024-09-21T07:07:33.572538+0000","last_became_active":"2024-09-21T07:07:32.562101+0000","last_became_peered":"2024-09-21T07:07:32.562101+0000","last_unstale":"2024-09-21T07:07:33.572538+0000","last_undegraded":"2024-09-21T07:07:33.572538+0000","last_fullsized":"2024-09-21T07:07:33.572538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:49.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.629665+0000","last_change":"2024-09-21T07:07:30.547263+0000","last_active":"2024-09-21T07:07:43.629665+0000","last_peered":"2024-09-21T07:07:43.629665+0000","last_clean":"2024-09-21T07:07:43.629665+0000","last_became_active":"2024-09-21T07:07:30.546874+0000","last_became_peered":"2024-09-21T07:07:30.546874+0000","last_unstale":"2024-09-21T07:07:43.629665+0000","last_undegraded":"2024-09-21T07:07:43.629665+0000","last_fullsized":"2024-09-21T07:07:43.629665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:18.545407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575642+0000","last_change":"2024-09-21T07:07:32.560288+0000","last_active":"2024-09-21T07:07:33.575642+0000","last_peered":"2024-09-21T07:07:33.575642+0000","last_clean":"2024-09-21T07:07:33.575642+0000","last_became_active":"2024-09-21T07:07:32.559938+0000","last_became_peered":"2024-09-21T07:07:32.559938+0000","last_unstale":"2024-09-21T07:07:33.575642+0000","last_undegraded":"2024-09-21T07:07:33.575642+0000","last_fullsized":"2024-09-21T07:07:33.575642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:55.531828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.672285+0000","last_change":"2024-09-21T07:07:30.754602+0000","last_active":"2024-09-21T07:07:57.672285+0000","last_peered":"2024-09-21T07:07:57.672285+0000","last_clean":"2024-09-21T07:07:57.672285+0000","last_became_active":"2024-09-21T07:07:30.754159+0000","last_became_peered":"2024-09-21T07:07:30.754159+0000","last_unstale":"2024-09-21T07:07:57.672285+0000","last_undegraded":"2024-09-21T07:07:57.672285+0000","last_fullsized":"2024-09-21T07:07:57.672285+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575056+0000","last_change":"2024-09-21T07:07:32.557819+0000","last_active":"2024-09-21T07:07:33.575056+0000","last_peered":"2024-09-21T07:07:33.575056+0000","last_clean":"2024-09-21T07:07:33.575056+0000","last_became_active":"2024-09-21T07:07:32.557363+0000","last_became_peered":"2024-09-21T07:07:32.557363+0000","last_unstale":"2024-09-21T07:07:33.575056+0000","last_undegraded":"2024-09-21T07:07:33.575056+0000","last_fullsized":"2024-09-21T07:07:33.575056+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.802658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":92,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572574+0000","last_change":"2024-09-21T07:06:20.138629+0000","last_active":"2024-09-21T07:07:33.572574+0000","last_peered":"2024-09-21T07:07:33.572574+0000","last_clean":"2024-09-21T07:07:33.572574+0000","last_became_active":"2024-09-21T07:06:20.132041+0000","last_became_peered":"2024-09-21T07:06:20.132041+0000","last_unstale":"2024-09-21T07:07:33.572574+0000","last_undegraded":"2024-09-21T07:07:33.572574+0000","last_fullsized":"2024-09-21T07:07:33.572574+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_clean_scrub_stamp":"2024-09-21T07:02:52.790893+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:41.784916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:44.633409+0000","last_change":"2024-09-21T07:07:30.541638+0000","last_active":"2024-09-21T07:07:44.633409+0000","last_peered":"2024-09-21T07:07:44.633409+0000","last_clean":"2024-09-21T07:07:44.633409+0000","last_became_active":"2024-09-21T07:07:30.541185+0000","last_became_peered":"2024-09-21T07:07:30.541185+0000","last_unstale":"2024-09-21T07:07:44.633409+0000","last_undegraded":"2024-09-21T07:07:44.633409+0000","last_fullsized":"2024-09-21T07:07:44.633409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:15.837077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573556+0000","last_change":"2024-09-21T07:07:32.560817+0000","last_active":"2024-09-21T07:07:33.573556+0000","last_peered":"2024-09-21T07:07:33.573556+0000","last_clean":"2024-09-21T07:07:33.573556+0000","last_became_active":"2024-09-21T07:07:32.560269+0000","last_became_peered":"2024-09-21T07:07:32.560269+0000","last_unstale":"2024-09-21T07:07:33.573556+0000","last_undegraded":"2024-09-21T07:07:33.573556+0000","last_fullsized":"2024-09-21T07:07:33.573556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:40.109644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:41.612838+0000","last_change":"2024-09-21T07:07:30.543936+0000","last_active":"2024-09-21T07:07:41.612838+0000","last_peered":"2024-09-21T07:07:41.612838+0000","last_clean":"2024-09-21T07:07:41.612838+0000","last_became_active":"2024-09-21T07:07:30.543530+0000","last_became_peered":"2024-09-21T07:07:30.543530+0000","last_unstale":"2024-09-21T07:07:41.612838+0000","last_undegraded":"2024-09-21T07:07:41.612838+0000","last_fullsized":"2024-09-21T07:07:41.612838+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:02.312471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564094+0000","last_change":"2024-09-21T07:07:32.542182+0000","last_active":"2024-09-21T07:07:33.564094+0000","last_peered":"2024-09-21T07:07:33.564094+0000","last_clean":"2024-09-21T07:07:33.564094+0000","last_became_active":"2024-09-21T07:07:32.541750+0000","last_became_peered":"2024-09-21T07:07:32.541750+0000","last_unstale":"2024-09-21T07:07:33.564094+0000","last_undegraded":"2024-09-21T07:07:33.564094+0000","last_fullsized":"2024-09-21T07:07:33.564094+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.184712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653368+0000","last_change":"2024-09-21T07:07:30.754978+0000","last_active":"2024-09-21T07:07:54.653368+0000","last_peered":"2024-09-21T07:07:54.653368+0000","last_clean":"2024-09-21T07:07:54.653368+0000","last_became_active":"2024-09-21T07:07:30.754149+0000","last_became_peered":"2024-09-21T07:07:30.754149+0000","last_unstale":"2024-09-21T07:07:54.653368+0000","last_undegraded":"2024-09-21T07:07:54.653368+0000","last_fullsized":"2024-09-21T07:07:54.653368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:36.140237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565483+0000","last_change":"2024-09-21T07:07:32.570424+0000","last_active":"2024-09-21T07:07:33.565483+0000","last_peered":"2024-09-21T07:07:33.565483+0000","last_clean":"2024-09-21T07:07:33.565483+0000","last_became_active":"2024-09-21T07:07:32.570029+0000","last_became_peered":"2024-09-21T07:07:32.570029+0000","last_unstale":"2024-09-21T07:07:33.565483+0000","last_undegraded":"2024-09-21T07:07:33.565483+0000","last_fullsized":"2024-09-21T07:07:33.565483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:09.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.652840+0000","last_change":"2024-09-21T07:07:30.543963+0000","last_active":"2024-09-21T07:07:54.652840+0000","last_peered":"2024-09-21T07:07:54.652840+0000","last_clean":"2024-09-21T07:07:54.652840+0000","last_became_active":"2024-09-21T07:07:30.543586+0000","last_became_peered":"2024-09-21T07:07:30.543586+0000","last_unstale":"2024-09-21T07:07:54.652840+0000","last_undegraded":"2024-09-21T07:07:54.652840+0000","last_fullsized":"2024-09-21T07:07:54.652840+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:05.782005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662307+0000","last_change":"2024-09-21T07:07:32.556132+0000","last_active":"2024-09-21T07:07:57.662307+0000","last_peered":"2024-09-21T07:07:57.662307+0000","last_clean":"2024-09-21T07:07:57.662307+0000","last_became_active":"2024-09-21T07:07:32.555717+0000","last_became_peered":"2024-09-21T07:07:32.555717+0000","last_unstale":"2024-09-21T07:07:57.662307+0000","last_undegraded":"2024-09-21T07:07:57.662307+0000","last_fullsized":"2024-09-21T07:07:57.662307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.809268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663009+0000","last_change":"2024-09-21T07:07:30.755143+0000","last_active":"2024-09-21T07:07:56.663009+0000","last_peered":"2024-09-21T07:07:56.663009+0000","last_clean":"2024-09-21T07:07:56.663009+0000","last_became_active":"2024-09-21T07:07:30.754591+0000","last_became_peered":"2024-09-21T07:07:30.754591+0000","last_unstale":"2024-09-21T07:07:56.663009+0000","last_undegraded":"2024-09-21T07:07:56.663009+0000","last_fullsized":"2024-09-21T07:07:56.663009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:13.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662201+0000","last_change":"2024-09-21T07:07:32.552869+0000","last_active":"2024-09-21T07:07:57.662201+0000","last_peered":"2024-09-21T07:07:57.662201+0000","last_clean":"2024-09-21T07:07:57.662201+0000","last_became_active":"2024-09-21T07:07:32.552483+0000","last_became_peered":"2024-09-21T07:07:32.552483+0000","last_unstale":"2024-09-21T07:07:57.662201+0000","last_undegraded":"2024-09-21T07:07:57.662201+0000","last_fullsized":"2024-09-21T07:07:57.662201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:21.006847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.669000+0000","last_change":"2024-09-21T07:07:30.755552+0000","last_active":"2024-09-21T07:07:56.669000+0000","last_peered":"2024-09-21T07:07:56.669000+0000","last_clean":"2024-09-21T07:07:56.669000+0000","last_became_active":"2024-09-21T07:07:30.754451+0000","last_became_peered":"2024-09-21T07:07:30.754451+0000","last_unstale":"2024-09-21T07:07:56.669000+0000","last_undegraded":"2024-09-21T07:07:56.669000+0000","last_fullsized":"2024-09-21T07:07:56.669000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:50.229649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564719+0000","last_change":"2024-09-21T07:07:32.543249+0000","last_active":"2024-09-21T07:07:33.564719+0000","last_peered":"2024-09-21T07:07:33.564719+0000","last_clean":"2024-09-21T07:07:33.564719+0000","last_became_active":"2024-09-21T07:07:32.542866+0000","last_became_peered":"2024-09-21T07:07:32.542866+0000","last_unstale":"2024-09-21T07:07:33.564719+0000","last_undegraded":"2024-09-21T07:07:33.564719+0000","last_fullsized":"2024-09-21T07:07:33.564719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:29.476454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'15","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663256+0000","last_change":"2024-09-21T07:07:30.541589+0000","last_active":"2024-09-21T07:07:56.663256+0000","last_peered":"2024-09-21T07:07:56.663256+0000","last_clean":"2024-09-21T07:07:56.663256+0000","last_became_active":"2024-09-21T07:07:30.541171+0000","last_became_peered":"2024-09-21T07:07:30.541171+0000","last_unstale":"2024-09-21T07:07:56.663256+0000","last_undegraded":"2024-09-21T07:07:56.663256+0000","last_fullsized":"2024-09-21T07:07:56.663256+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:46.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574294+0000","last_change":"2024-09-21T07:07:32.558409+0000","last_active":"2024-09-21T07:07:33.574294+0000","last_peered":"2024-09-21T07:07:33.574294+0000","last_clean":"2024-09-21T07:07:33.574294+0000","last_became_active":"2024-09-21T07:07:32.557886+0000","last_became_peered":"2024-09-21T07:07:32.557886+0000","last_unstale":"2024-09-21T07:07:33.574294+0000","last_undegraded":"2024-09-21T07:07:33.574294+0000","last_fullsized":"2024-09-21T07:07:33.574294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.071651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.628769+0000","last_change":"2024-09-21T07:07:30.536107+0000","last_active":"2024-09-21T07:07:43.628769+0000","last_peered":"2024-09-21T07:07:43.628769+0000","last_clean":"2024-09-21T07:07:43.628769+0000","last_became_active":"2024-09-21T07:07:30.535455+0000","last_became_peered":"2024-09-21T07:07:30.535455+0000","last_unstale":"2024-09-21T07:07:43.628769+0000","last_undegraded":"2024-09-21T07:07:43.628769+0000","last_fullsized":"2024-09-21T07:07:43.628769+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:55.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572308+0000","last_change":"2024-09-21T07:07:32.553187+0000","last_active":"2024-09-21T07:07:33.572308+0000","last_peered":"2024-09-21T07:07:33.572308+0000","last_clean":"2024-09-21T07:07:33.572308+0000","last_became_active":"2024-09-21T07:07:32.552905+0000","last_became_peered":"2024-09-21T07:07:32.552905+0000","last_unstale":"2024-09-21T07:07:33.572308+0000","last_undegraded":"2024-09-21T07:07:33.572308+0000","last_fullsized":"2024-09-21T07:07:33.572308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:24.790329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665358+0000","last_change":"2024-09-21T07:07:30.754858+0000","last_active":"2024-09-21T07:07:56.665358+0000","last_peered":"2024-09-21T07:07:56.665358+0000","last_clean":"2024-09-21T07:07:56.665358+0000","last_became_active":"2024-09-21T07:07:30.754483+0000","last_became_peered":"2024-09-21T07:07:30.754483+0000","last_unstale":"2024-09-21T07:07:56.665358+0000","last_undegraded":"2024-09-21T07:07:56.665358+0000","last_fullsized":"2024-09-21T07:07:56.665358+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:29.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666429+0000","last_change":"2024-09-21T07:07:32.562213+0000","last_active":"2024-09-21T07:07:56.666429+0000","last_peered":"2024-09-21T07:07:56.666429+0000","last_clean":"2024-09-21T07:07:56.666429+0000","last_became_active":"2024-09-21T07:07:32.561834+0000","last_became_peered":"2024-09-21T07:07:32.561834+0000","last_unstale":"2024-09-21T07:07:56.666429+0000","last_undegraded":"2024-09-21T07:07:56.666429+0000","last_fullsized":"2024-09-21T07:07:56.666429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:12.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.627147+0000","last_change":"2024-09-21T07:07:30.543455+0000","last_active":"2024-09-21T07:07:43.627147+0000","last_peered":"2024-09-21T07:07:43.627147+0000","last_clean":"2024-09-21T07:07:43.627147+0000","last_became_active":"2024-09-21T07:07:30.543059+0000","last_became_peered":"2024-09-21T07:07:30.543059+0000","last_unstale":"2024-09-21T07:07:43.627147+0000","last_undegraded":"2024-09-21T07:07:43.627147+0000","last_fullsized":"2024-09-21T07:07:43.627147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.896121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664245+0000","last_change":"2024-09-21T07:07:32.560600+0000","last_active":"2024-09-21T07:07:57.664245+0000","last_peered":"2024-09-21T07:07:57.664245+0000","last_clean":"2024-09-21T07:07:57.664245+0000","last_became_active":"2024-09-21T07:07:32.560159+0000","last_became_peered":"2024-09-21T07:07:32.560159+0000","last_unstale":"2024-09-21T07:07:57.664245+0000","last_undegraded":"2024-09-21T07:07:57.664245+0000","last_fullsized":"2024-09-21T07:07:57.664245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.228180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.683341+0000","last_change":"2024-09-21T07:07:57.682685+0000","last_active":"2024-09-21T07:07:57.683341+0000","last_peered":"2024-09-21T07:07:57.683341+0000","last_clean":"2024-09-21T07:07:57.683341+0000","last_became_active":"2024-09-21T07:07:57.671259+0000","last_became_peered":"2024-09-21T07:07:57.671259+0000","last_unstale":"2024-09-21T07:07:57.683341+0000","last_undegraded":"2024-09-21T07:07:57.683341+0000","last_fullsized":"2024-09-21T07:07:57.683341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573373+0000","last_change":"2024-09-21T07:07:32.554033+0000","last_active":"2024-09-21T07:07:33.573373+0000","last_peered":"2024-09-21T07:07:33.573373+0000","last_clean":"2024-09-21T07:07:33.573373+0000","last_became_active":"2024-09-21T07:07:32.553654+0000","last_became_peered":"2024-09-21T07:07:32.553654+0000","last_unstale":"2024-09-21T07:07:33.573373+0000","last_undegraded":"2024-09-21T07:07:33.573373+0000","last_fullsized":"2024-09-21T07:07:33.573373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:15.876104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666978+0000","last_change":"2024-09-21T07:07:30.547818+0000","last_active":"2024-09-21T07:07:56.666978+0000","last_peered":"2024-09-21T07:07:56.666978+0000","last_clean":"2024-09-21T07:07:56.666978+0000","last_became_active":"2024-09-21T07:07:30.547387+0000","last_became_peered":"2024-09-21T07:07:30.547387+0000","last_unstale":"2024-09-21T07:07:56.666978+0000","last_undegraded":"2024-09-21T07:07:56.666978+0000","last_fullsized":"2024-09-21T07:07:56.666978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572574+0000","last_change":"2024-09-21T07:07:32.566731+0000","last_active":"2024-09-21T07:07:33.572574+0000","last_peered":"2024-09-21T07:07:33.572574+0000","last_clean":"2024-09-21T07:07:33.572574+0000","last_became_active":"2024-09-21T07:07:32.566233+0000","last_became_peered":"2024-09-21T07:07:32.566233+0000","last_unstale":"2024-09-21T07:07:33.572574+0000","last_undegraded":"2024-09-21T07:07:33.572574+0000","last_fullsized":"2024-09-21T07:07:33.572574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:57.630088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565418+0000","last_change":"2024-09-21T07:07:32.570224+0000","last_active":"2024-09-21T07:07:33.565418+0000","last_peered":"2024-09-21T07:07:33.565418+0000","last_clean":"2024-09-21T07:07:33.565418+0000","last_became_active":"2024-09-21T07:07:32.569847+0000","last_became_peered":"2024-09-21T07:07:32.569847+0000","last_unstale":"2024-09-21T07:07:33.565418+0000","last_undegraded":"2024-09-21T07:07:33.565418+0000","last_fullsized":"2024-09-21T07:07:33.565418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:44.565390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.668041+0000","last_change":"2024-09-21T07:07:30.544884+0000","last_active":"2024-09-21T07:07:56.668041+0000","last_peered":"2024-09-21T07:07:56.668041+0000","last_clean":"2024-09-21T07:07:56.668041+0000","last_became_active":"2024-09-21T07:07:30.543321+0000","last_became_peered":"2024-09-21T07:07:30.543321+0000","last_unstale":"2024-09-21T07:07:56.668041+0000","last_undegraded":"2024-09-21T07:07:56.668041+0000","last_fullsized":"2024-09-21T07:07:56.668041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.234905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665654+0000","last_change":"2024-09-21T07:07:32.566124+0000","last_active":"2024-09-21T07:07:56.665654+0000","last_peered":"2024-09-21T07:07:56.665654+0000","last_clean":"2024-09-21T07:07:56.665654+0000","last_became_active":"2024-09-21T07:07:32.565743+0000","last_became_peered":"2024-09-21T07:07:32.565743+0000","last_unstale":"2024-09-21T07:07:56.665654+0000","last_undegraded":"2024-09-21T07:07:56.665654+0000","last_fullsized":"2024-09-21T07:07:56.665654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:57.048529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.669538+0000","last_change":"2024-09-21T07:07:30.546742+0000","last_active":"2024-09-21T07:07:56.669538+0000","last_peered":"2024-09-21T07:07:56.669538+0000","last_clean":"2024-09-21T07:07:56.669538+0000","last_became_active":"2024-09-21T07:07:30.546300+0000","last_became_peered":"2024-09-21T07:07:30.546300+0000","last_unstale":"2024-09-21T07:07:56.669538+0000","last_undegraded":"2024-09-21T07:07:56.669538+0000","last_fullsized":"2024-09-21T07:07:56.669538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:58.903582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574773+0000","last_change":"2024-09-21T07:07:32.565602+0000","last_active":"2024-09-21T07:07:33.574773+0000","last_peered":"2024-09-21T07:07:33.574773+0000","last_clean":"2024-09-21T07:07:33.574773+0000","last_became_active":"2024-09-21T07:07:32.565252+0000","last_became_peered":"2024-09-21T07:07:32.565252+0000","last_unstale":"2024-09-21T07:07:33.574773+0000","last_undegraded":"2024-09-21T07:07:33.574773+0000","last_fullsized":"2024-09-21T07:07:33.574773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:50.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.579859+0000","last_change":"2024-09-21T07:07:30.754535+0000","last_active":"2024-09-21T07:07:33.579859+0000","last_peered":"2024-09-21T07:07:33.579859+0000","last_clean":"2024-09-21T07:07:33.579859+0000","last_became_active":"2024-09-21T07:07:30.754129+0000","last_became_peered":"2024-09-21T07:07:30.754129+0000","last_unstale":"2024-09-21T07:07:33.579859+0000","last_undegraded":"2024-09-21T07:07:33.579859+0000","last_fullsized":"2024-09-21T07:07:33.579859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:23.800713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574580+0000","last_change":"2024-09-21T07:07:32.561210+0000","last_active":"2024-09-21T07:07:33.574580+0000","last_peered":"2024-09-21T07:07:33.574580+0000","last_clean":"2024-09-21T07:07:33.574580+0000","last_became_active":"2024-09-21T07:07:32.560850+0000","last_became_peered":"2024-09-21T07:07:32.560850+0000","last_unstale":"2024-09-21T07:07:33.574580+0000","last_undegraded":"2024-09-21T07:07:33.574580+0000","last_fullsized":"2024-09-21T07:07:33.574580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.212097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663194+0000","last_change":"2024-09-21T07:07:30.543778+0000","last_active":"2024-09-21T07:07:56.663194+0000","last_peered":"2024-09-21T07:07:56.663194+0000","last_clean":"2024-09-21T07:07:56.663194+0000","last_became_active":"2024-09-21T07:07:30.543474+0000","last_became_peered":"2024-09-21T07:07:30.543474+0000","last_unstale":"2024-09-21T07:07:56.663194+0000","last_undegraded":"2024-09-21T07:07:56.663194+0000","last_fullsized":"2024-09-21T07:07:56.663194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:06.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70364,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":242,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":194086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808850,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":395386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40992,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704160,"statfs":{"total":95995035648,"available":95953059840,"internally_reserved":0,"allocated":1515520,"data_stored":1040648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":386444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":378179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528358,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1413120,"data_stored":971088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":969984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":377343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":872448,"data_stored":441720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40308,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704844,"statfs":{"total":95995035648,"available":95953760256,"internally_reserved":0,"allocated":823296,"data_stored":379248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:08:00.958 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:08:01.222 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:01.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 -- 172.21.15.29:0/4116714082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b90109df0 msgr2=0x7f2b90110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:01.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 --2- 172.21.15.29:0/4116714082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b90109df0 0x7f2b90110620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009ca0 tx=0x7f2b8802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 -- 172.21.15.29:0/4116714082 shutdown_connections 2024-09-21T07:08:01.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 --2- 172.21.15.29:0/4116714082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b90109df0 0x7f2b90110620 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 --2- 172.21.15.29:0/4116714082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b901094a0 0x7f2b901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 --2- 172.21.15.29:0/4116714082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b90103b60 0x7f2b90103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 -- 172.21.15.29:0/4116714082 >> 172.21.15.29:0/4116714082 conn(0x7f2b9007b850 msgr2=0x7f2b9007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 -- 172.21.15.29:0/4116714082 shutdown_connections 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.700+0000 7f2b962d3640 1 -- 172.21.15.29:0/4116714082 wait complete. 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 Processor -- start 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 -- start start 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b90103b60 0x7f2b90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b901094a0 0x7f2b90075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b90109df0 0x7f2b90076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90113ab0 con 0x7f2b901094a0 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90113930 con 0x7f2b90109df0 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b962d3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90113c30 con 0x7f2b90103b60 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b87fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b901094a0 0x7f2b90075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:01.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b87fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b901094a0 0x7f2b90075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50378/0 (socket says 172.21.15.29:50378) 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b87fff640 1 -- 172.21.15.29:0/2201607081 learned_addr learned my addr 172.21.15.29:0/2201607081 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b8ffff640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b90103b60 0x7f2b90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b94870640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b90109df0 0x7f2b90076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b87fff640 1 -- 172.21.15.29:0/2201607081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b90103b60 msgr2=0x7f2b90075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b87fff640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b90103b60 0x7f2b90075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b87fff640 1 -- 172.21.15.29:0/2201607081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b90109df0 msgr2=0x7f2b90076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.701+0000 7f2b87fff640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b90109df0 0x7f2b90076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b87fff640 1 -- 172.21.15.29:0/2201607081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b901a8700 con 0x7f2b901094a0 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b8ffff640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b90103b60 0x7f2b90075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b94870640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b90109df0 0x7f2b90076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b87fff640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b901094a0 0x7f2b90075c50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800d740 tx=0x7f2b7800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b8dffb640 1 -- 172.21.15.29:0/2201607081 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78017070 con 0x7f2b901094a0 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b8dffb640 1 -- 172.21.15.29:0/2201607081 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b7800de50 con 0x7f2b901094a0 2024-09-21T07:08:01.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b8dffb640 1 -- 172.21.15.29:0/2201607081 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800f620 con 0x7f2b901094a0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b901a89f0 con 0x7f2b901094a0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.702+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b901a8ee0 con 0x7f2b901094a0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.703+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b90103f70 con 0x7f2b901094a0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.705+0000 7f2b8dffb640 1 -- 172.21.15.29:0/2201607081 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2b7801a070 con 0x7f2b901094a0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.706+0000 7f2b8dffb640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2b7c0b6620 0x7f2b7c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.706+0000 7f2b8ffff640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2b7c0b6620 0x7f2b7c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.706+0000 7f2b8dffb640 1 -- 172.21.15.29:0/2201607081 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2b780e6ed0 con 0x7f2b901094a0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.706+0000 7f2b8ffff640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2b7c0b6620 0x7f2b7c0b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b80005fd0 tx=0x7f2b80005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:01.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.709+0000 7f2b8dffb640 1 -- 172.21.15.29:0/2201607081 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b780ad690 con 0x7f2b901094a0 2024-09-21T07:08:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:01 smithi029 ceph-mon[30983]: pgmap v307: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.1 KiB/s wr, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:01 smithi029 ceph-mon[30983]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:01.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.893+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b9002e670 con 0x7f2b7c0b6620 2024-09-21T07:08:01.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.898+0000 7f2b8dffb640 1 -- 172.21.15.29:0/2201607081 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258695 (secure 0 0 0) 0x7f2b9002e670 con 0x7f2b7c0b6620 2024-09-21T07:08:01.903 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:01.904 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T07:08:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2b7c0b6620 msgr2=0x7f2b7c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2b7c0b6620 0x7f2b7c0b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b80005fd0 tx=0x7f2b80005850 comp rx=0 tx=0).stop 2024-09-21T07:08:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b901094a0 msgr2=0x7f2b90075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b901094a0 0x7f2b90075c50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800d740 tx=0x7f2b7800dc00 comp rx=0 tx=0).stop 2024-09-21T07:08:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 shutdown_connections 2024-09-21T07:08:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2b7c0b6620 0x7f2b7c0b8b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b90109df0 0x7f2b90076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b901094a0 0x7f2b90075c50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 --2- 172.21.15.29:0/2201607081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b90103b60 0x7f2b90075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.901+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 >> 172.21.15.29:0/2201607081 conn(0x7f2b9007b850 msgr2=0x7f2b90105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.902+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 shutdown_connections 2024-09-21T07:08:01.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:01.902+0000 7f2b962d3640 1 -- 172.21.15.29:0/2201607081 wait complete. 2024-09-21T07:08:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:01 smithi052 ceph-mon[34308]: pgmap v307: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.1 KiB/s wr, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:01 smithi052 ceph-mon[34308]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:01 smithi066 ceph-mon[34793]: pgmap v307: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.1 KiB/s wr, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:01 smithi066 ceph-mon[34793]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:02.792 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-21T07:07:59.998026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660966,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":250,"num_read_kb":221,"num_write":367,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385796,"kb_used_data":11560,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556028,"statfs":{"total":1151940427776,"available":1151545372672,"internally_reserved":0,"allocated":11837440,"data_stored":6537659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33754,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":73,"num_write":23,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002197"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665830+0000","last_change":"2024-09-21T07:07:32.566786+0000","last_active":"2024-09-21T07:07:57.665830+0000","last_peered":"2024-09-21T07:07:57.665830+0000","last_clean":"2024-09-21T07:07:57.665830+0000","last_became_active":"2024-09-21T07:07:32.565722+0000","last_became_peered":"2024-09-21T07:07:32.565722+0000","last_unstale":"2024-09-21T07:07:57.665830+0000","last_undegraded":"2024-09-21T07:07:57.665830+0000","last_fullsized":"2024-09-21T07:07:57.665830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:22.389773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574477+0000","last_change":"2024-09-21T07:07:32.556460+0000","last_active":"2024-09-21T07:07:33.574477+0000","last_peered":"2024-09-21T07:07:33.574477+0000","last_clean":"2024-09-21T07:07:33.574477+0000","last_became_active":"2024-09-21T07:07:32.555738+0000","last_became_peered":"2024-09-21T07:07:32.555738+0000","last_unstale":"2024-09-21T07:07:33.574477+0000","last_undegraded":"2024-09-21T07:07:33.574477+0000","last_fullsized":"2024-09-21T07:07:33.574477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.921413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572563+0000","last_change":"2024-09-21T07:07:32.565814+0000","last_active":"2024-09-21T07:07:33.572563+0000","last_peered":"2024-09-21T07:07:33.572563+0000","last_clean":"2024-09-21T07:07:33.572563+0000","last_became_active":"2024-09-21T07:07:32.565401+0000","last_became_peered":"2024-09-21T07:07:32.565401+0000","last_unstale":"2024-09-21T07:07:33.572563+0000","last_undegraded":"2024-09-21T07:07:33.572563+0000","last_fullsized":"2024-09-21T07:07:33.572563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:56.705903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565506+0000","last_change":"2024-09-21T07:07:32.554713+0000","last_active":"2024-09-21T07:07:33.565506+0000","last_peered":"2024-09-21T07:07:33.565506+0000","last_clean":"2024-09-21T07:07:33.565506+0000","last_became_active":"2024-09-21T07:07:32.554203+0000","last_became_peered":"2024-09-21T07:07:32.554203+0000","last_unstale":"2024-09-21T07:07:33.565506+0000","last_undegraded":"2024-09-21T07:07:33.565506+0000","last_fullsized":"2024-09-21T07:07:33.565506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:29.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666797+0000","last_change":"2024-09-21T07:07:32.566048+0000","last_active":"2024-09-21T07:07:56.666797+0000","last_peered":"2024-09-21T07:07:56.666797+0000","last_clean":"2024-09-21T07:07:56.666797+0000","last_became_active":"2024-09-21T07:07:32.565659+0000","last_became_peered":"2024-09-21T07:07:32.565659+0000","last_unstale":"2024-09-21T07:07:56.666797+0000","last_undegraded":"2024-09-21T07:07:56.666797+0000","last_fullsized":"2024-09-21T07:07:56.666797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:56.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662196+0000","last_change":"2024-09-21T07:07:32.550492+0000","last_active":"2024-09-21T07:07:57.662196+0000","last_peered":"2024-09-21T07:07:57.662196+0000","last_clean":"2024-09-21T07:07:57.662196+0000","last_became_active":"2024-09-21T07:07:32.549691+0000","last_became_peered":"2024-09-21T07:07:32.549691+0000","last_unstale":"2024-09-21T07:07:57.662196+0000","last_undegraded":"2024-09-21T07:07:57.662196+0000","last_fullsized":"2024-09-21T07:07:57.662196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.890164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572221+0000","last_change":"2024-09-21T07:07:32.560258+0000","last_active":"2024-09-21T07:07:33.572221+0000","last_peered":"2024-09-21T07:07:33.572221+0000","last_clean":"2024-09-21T07:07:33.572221+0000","last_became_active":"2024-09-21T07:07:32.559890+0000","last_became_peered":"2024-09-21T07:07:32.559890+0000","last_unstale":"2024-09-21T07:07:33.572221+0000","last_undegraded":"2024-09-21T07:07:33.572221+0000","last_fullsized":"2024-09-21T07:07:33.572221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.794736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573718+0000","last_change":"2024-09-21T07:07:32.560923+0000","last_active":"2024-09-21T07:07:33.573718+0000","last_peered":"2024-09-21T07:07:33.573718+0000","last_clean":"2024-09-21T07:07:33.573718+0000","last_became_active":"2024-09-21T07:07:32.560509+0000","last_became_peered":"2024-09-21T07:07:32.560509+0000","last_unstale":"2024-09-21T07:07:33.573718+0000","last_undegraded":"2024-09-21T07:07:33.573718+0000","last_fullsized":"2024-09-21T07:07:33.573718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:59.576434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.664977+0000","last_change":"2024-09-21T07:07:32.564475+0000","last_active":"2024-09-21T07:07:56.664977+0000","last_peered":"2024-09-21T07:07:56.664977+0000","last_clean":"2024-09-21T07:07:56.664977+0000","last_became_active":"2024-09-21T07:07:32.564115+0000","last_became_peered":"2024-09-21T07:07:32.564115+0000","last_unstale":"2024-09-21T07:07:56.664977+0000","last_undegraded":"2024-09-21T07:07:56.664977+0000","last_fullsized":"2024-09-21T07:07:56.664977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:03.989109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662889+0000","last_change":"2024-09-21T07:07:32.557377+0000","last_active":"2024-09-21T07:07:57.662889+0000","last_peered":"2024-09-21T07:07:57.662889+0000","last_clean":"2024-09-21T07:07:57.662889+0000","last_became_active":"2024-09-21T07:07:32.556732+0000","last_became_peered":"2024-09-21T07:07:32.556732+0000","last_unstale":"2024-09-21T07:07:57.662889+0000","last_undegraded":"2024-09-21T07:07:57.662889+0000","last_fullsized":"2024-09-21T07:07:57.662889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:32.474690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574804+0000","last_change":"2024-09-21T07:07:32.558691+0000","last_active":"2024-09-21T07:07:33.574804+0000","last_peered":"2024-09-21T07:07:33.574804+0000","last_clean":"2024-09-21T07:07:33.574804+0000","last_became_active":"2024-09-21T07:07:32.558029+0000","last_became_peered":"2024-09-21T07:07:32.558029+0000","last_unstale":"2024-09-21T07:07:33.574804+0000","last_undegraded":"2024-09-21T07:07:33.574804+0000","last_fullsized":"2024-09-21T07:07:33.574804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.378786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565633+0000","last_change":"2024-09-21T07:07:32.556500+0000","last_active":"2024-09-21T07:07:33.565633+0000","last_peered":"2024-09-21T07:07:33.565633+0000","last_clean":"2024-09-21T07:07:33.565633+0000","last_became_active":"2024-09-21T07:07:32.555529+0000","last_became_peered":"2024-09-21T07:07:32.555529+0000","last_unstale":"2024-09-21T07:07:33.565633+0000","last_undegraded":"2024-09-21T07:07:33.565633+0000","last_fullsized":"2024-09-21T07:07:33.565633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.494498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564386+0000","last_change":"2024-09-21T07:07:32.560235+0000","last_active":"2024-09-21T07:07:33.564386+0000","last_peered":"2024-09-21T07:07:33.564386+0000","last_clean":"2024-09-21T07:07:33.564386+0000","last_became_active":"2024-09-21T07:07:32.559834+0000","last_became_peered":"2024-09-21T07:07:32.559834+0000","last_unstale":"2024-09-21T07:07:33.564386+0000","last_undegraded":"2024-09-21T07:07:33.564386+0000","last_fullsized":"2024-09-21T07:07:33.564386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:30.090878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572860+0000","last_change":"2024-09-21T07:07:32.554158+0000","last_active":"2024-09-21T07:07:33.572860+0000","last_peered":"2024-09-21T07:07:33.572860+0000","last_clean":"2024-09-21T07:07:33.572860+0000","last_became_active":"2024-09-21T07:07:32.553837+0000","last_became_peered":"2024-09-21T07:07:32.553837+0000","last_unstale":"2024-09-21T07:07:33.572860+0000","last_undegraded":"2024-09-21T07:07:33.572860+0000","last_fullsized":"2024-09-21T07:07:33.572860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:23.845629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572280+0000","last_change":"2024-09-21T07:07:32.556921+0000","last_active":"2024-09-21T07:07:33.572280+0000","last_peered":"2024-09-21T07:07:33.572280+0000","last_clean":"2024-09-21T07:07:33.572280+0000","last_became_active":"2024-09-21T07:07:32.556529+0000","last_became_peered":"2024-09-21T07:07:32.556529+0000","last_unstale":"2024-09-21T07:07:33.572280+0000","last_undegraded":"2024-09-21T07:07:33.572280+0000","last_fullsized":"2024-09-21T07:07:33.572280+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.447617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665137+0000","last_change":"2024-09-21T07:07:32.567572+0000","last_active":"2024-09-21T07:07:56.665137+0000","last_peered":"2024-09-21T07:07:56.665137+0000","last_clean":"2024-09-21T07:07:56.665137+0000","last_became_active":"2024-09-21T07:07:32.567159+0000","last_became_peered":"2024-09-21T07:07:32.567159+0000","last_unstale":"2024-09-21T07:07:56.665137+0000","last_undegraded":"2024-09-21T07:07:56.665137+0000","last_fullsized":"2024-09-21T07:07:56.665137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.316539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665990+0000","last_change":"2024-09-21T07:07:32.567213+0000","last_active":"2024-09-21T07:07:57.665990+0000","last_peered":"2024-09-21T07:07:57.665990+0000","last_clean":"2024-09-21T07:07:57.665990+0000","last_became_active":"2024-09-21T07:07:32.566284+0000","last_became_peered":"2024-09-21T07:07:32.566284+0000","last_unstale":"2024-09-21T07:07:57.665990+0000","last_undegraded":"2024-09-21T07:07:57.665990+0000","last_fullsized":"2024-09-21T07:07:57.665990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663157+0000","last_change":"2024-09-21T07:07:32.551695+0000","last_active":"2024-09-21T07:07:56.663157+0000","last_peered":"2024-09-21T07:07:56.663157+0000","last_clean":"2024-09-21T07:07:56.663157+0000","last_became_active":"2024-09-21T07:07:32.551282+0000","last_became_peered":"2024-09-21T07:07:32.551282+0000","last_unstale":"2024-09-21T07:07:56.663157+0000","last_undegraded":"2024-09-21T07:07:56.663157+0000","last_fullsized":"2024-09-21T07:07:56.663157+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:33.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669799+0000","last_change":"2024-09-21T07:07:32.551000+0000","last_active":"2024-09-21T07:07:57.669799+0000","last_peered":"2024-09-21T07:07:57.669799+0000","last_clean":"2024-09-21T07:07:57.669799+0000","last_became_active":"2024-09-21T07:07:32.550590+0000","last_became_peered":"2024-09-21T07:07:32.550590+0000","last_unstale":"2024-09-21T07:07:57.669799+0000","last_undegraded":"2024-09-21T07:07:57.669799+0000","last_fullsized":"2024-09-21T07:07:57.669799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:30.213470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668399+0000","last_change":"2024-09-21T07:07:57.668284+0000","last_active":"2024-09-21T07:07:57.668399+0000","last_peered":"2024-09-21T07:07:57.668399+0000","last_clean":"2024-09-21T07:07:57.668399+0000","last_became_active":"2024-09-21T07:07:57.667145+0000","last_became_peered":"2024-09-21T07:07:57.667145+0000","last_unstale":"2024-09-21T07:07:57.668399+0000","last_undegraded":"2024-09-21T07:07:57.668399+0000","last_fullsized":"2024-09-21T07:07:57.668399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:11.662321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564501+0000","last_change":"2024-09-21T07:07:32.555752+0000","last_active":"2024-09-21T07:07:33.564501+0000","last_peered":"2024-09-21T07:07:33.564501+0000","last_clean":"2024-09-21T07:07:33.564501+0000","last_became_active":"2024-09-21T07:07:32.555057+0000","last_became_peered":"2024-09-21T07:07:32.555057+0000","last_unstale":"2024-09-21T07:07:33.564501+0000","last_undegraded":"2024-09-21T07:07:33.564501+0000","last_fullsized":"2024-09-21T07:07:33.564501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:03.161990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666031+0000","last_change":"2024-09-21T07:07:32.555589+0000","last_active":"2024-09-21T07:07:56.666031+0000","last_peered":"2024-09-21T07:07:56.666031+0000","last_clean":"2024-09-21T07:07:56.666031+0000","last_became_active":"2024-09-21T07:07:32.555037+0000","last_became_peered":"2024-09-21T07:07:32.555037+0000","last_unstale":"2024-09-21T07:07:56.666031+0000","last_undegraded":"2024-09-21T07:07:56.666031+0000","last_fullsized":"2024-09-21T07:07:56.666031+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:25.346546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573881+0000","last_change":"2024-09-21T07:07:32.559407+0000","last_active":"2024-09-21T07:07:33.573881+0000","last_peered":"2024-09-21T07:07:33.573881+0000","last_clean":"2024-09-21T07:07:33.573881+0000","last_became_active":"2024-09-21T07:07:32.559112+0000","last_became_peered":"2024-09-21T07:07:32.559112+0000","last_unstale":"2024-09-21T07:07:33.573881+0000","last_undegraded":"2024-09-21T07:07:33.573881+0000","last_fullsized":"2024-09-21T07:07:33.573881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:13.970511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564994+0000","last_change":"2024-09-21T07:07:32.564798+0000","last_active":"2024-09-21T07:07:33.564994+0000","last_peered":"2024-09-21T07:07:33.564994+0000","last_clean":"2024-09-21T07:07:33.564994+0000","last_became_active":"2024-09-21T07:07:32.564381+0000","last_became_peered":"2024-09-21T07:07:32.564381+0000","last_unstale":"2024-09-21T07:07:33.564994+0000","last_undegraded":"2024-09-21T07:07:33.564994+0000","last_fullsized":"2024-09-21T07:07:33.564994+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:19.667252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574263+0000","last_change":"2024-09-21T07:07:32.555274+0000","last_active":"2024-09-21T07:07:33.574263+0000","last_peered":"2024-09-21T07:07:33.574263+0000","last_clean":"2024-09-21T07:07:33.574263+0000","last_became_active":"2024-09-21T07:07:32.554816+0000","last_became_peered":"2024-09-21T07:07:32.554816+0000","last_unstale":"2024-09-21T07:07:33.574263+0000","last_undegraded":"2024-09-21T07:07:33.574263+0000","last_fullsized":"2024-09-21T07:07:33.574263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.018974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.671064+0000","last_change":"2024-09-21T07:07:32.555655+0000","last_active":"2024-09-21T07:07:57.671064+0000","last_peered":"2024-09-21T07:07:57.671064+0000","last_clean":"2024-09-21T07:07:57.671064+0000","last_became_active":"2024-09-21T07:07:32.555240+0000","last_became_peered":"2024-09-21T07:07:32.555240+0000","last_unstale":"2024-09-21T07:07:57.671064+0000","last_undegraded":"2024-09-21T07:07:57.671064+0000","last_fullsized":"2024-09-21T07:07:57.671064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:51.550091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664496+0000","last_change":"2024-09-21T07:07:32.570761+0000","last_active":"2024-09-21T07:07:57.664496+0000","last_peered":"2024-09-21T07:07:57.664496+0000","last_clean":"2024-09-21T07:07:57.664496+0000","last_became_active":"2024-09-21T07:07:32.569555+0000","last_became_peered":"2024-09-21T07:07:32.569555+0000","last_unstale":"2024-09-21T07:07:57.664496+0000","last_undegraded":"2024-09-21T07:07:57.664496+0000","last_fullsized":"2024-09-21T07:07:57.664496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:23.414096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564554+0000","last_change":"2024-09-21T07:07:32.548955+0000","last_active":"2024-09-21T07:07:33.564554+0000","last_peered":"2024-09-21T07:07:33.564554+0000","last_clean":"2024-09-21T07:07:33.564554+0000","last_became_active":"2024-09-21T07:07:32.548562+0000","last_became_peered":"2024-09-21T07:07:32.548562+0000","last_unstale":"2024-09-21T07:07:33.564554+0000","last_undegraded":"2024-09-21T07:07:33.564554+0000","last_fullsized":"2024-09-21T07:07:33.564554+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:24.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572567+0000","last_change":"2024-09-21T07:07:32.550889+0000","last_active":"2024-09-21T07:07:33.572567+0000","last_peered":"2024-09-21T07:07:33.572567+0000","last_clean":"2024-09-21T07:07:33.572567+0000","last_became_active":"2024-09-21T07:07:32.550559+0000","last_became_peered":"2024-09-21T07:07:32.550559+0000","last_unstale":"2024-09-21T07:07:33.572567+0000","last_undegraded":"2024-09-21T07:07:33.572567+0000","last_fullsized":"2024-09-21T07:07:33.572567+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:35.575626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669528+0000","last_change":"2024-09-21T07:07:32.552019+0000","last_active":"2024-09-21T07:07:57.669528+0000","last_peered":"2024-09-21T07:07:57.669528+0000","last_clean":"2024-09-21T07:07:57.669528+0000","last_became_active":"2024-09-21T07:07:32.551562+0000","last_became_peered":"2024-09-21T07:07:32.551562+0000","last_unstale":"2024-09-21T07:07:57.669528+0000","last_undegraded":"2024-09-21T07:07:57.669528+0000","last_fullsized":"2024-09-21T07:07:57.669528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:25.932560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669832+0000","last_change":"2024-09-21T07:07:32.556938+0000","last_active":"2024-09-21T07:07:57.669832+0000","last_peered":"2024-09-21T07:07:57.669832+0000","last_clean":"2024-09-21T07:07:57.669832+0000","last_became_active":"2024-09-21T07:07:32.556331+0000","last_became_peered":"2024-09-21T07:07:32.556331+0000","last_unstale":"2024-09-21T07:07:57.669832+0000","last_undegraded":"2024-09-21T07:07:57.669832+0000","last_fullsized":"2024-09-21T07:07:57.669832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.358076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664137+0000","last_change":"2024-09-21T07:07:32.561984+0000","last_active":"2024-09-21T07:07:57.664137+0000","last_peered":"2024-09-21T07:07:57.664137+0000","last_clean":"2024-09-21T07:07:57.664137+0000","last_became_active":"2024-09-21T07:07:32.561227+0000","last_became_peered":"2024-09-21T07:07:32.561227+0000","last_unstale":"2024-09-21T07:07:57.664137+0000","last_undegraded":"2024-09-21T07:07:57.664137+0000","last_fullsized":"2024-09-21T07:07:57.664137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:35.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.667130+0000","last_change":"2024-09-21T07:07:32.567454+0000","last_active":"2024-09-21T07:07:56.667130+0000","last_peered":"2024-09-21T07:07:56.667130+0000","last_clean":"2024-09-21T07:07:56.667130+0000","last_became_active":"2024-09-21T07:07:32.567063+0000","last_became_peered":"2024-09-21T07:07:32.567063+0000","last_unstale":"2024-09-21T07:07:56.667130+0000","last_undegraded":"2024-09-21T07:07:56.667130+0000","last_fullsized":"2024-09-21T07:07:56.667130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.466771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653759+0000","last_change":"2024-09-21T07:07:30.548785+0000","last_active":"2024-09-21T07:07:54.653759+0000","last_peered":"2024-09-21T07:07:54.653759+0000","last_clean":"2024-09-21T07:07:54.653759+0000","last_became_active":"2024-09-21T07:07:30.547764+0000","last_became_peered":"2024-09-21T07:07:30.547764+0000","last_unstale":"2024-09-21T07:07:54.653759+0000","last_undegraded":"2024-09-21T07:07:54.653759+0000","last_fullsized":"2024-09-21T07:07:54.653759+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:18.115002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":2,"reported_epoch":74,"state":"peering","last_fresh":"2024-09-21T07:07:32.545905+0000","last_change":"2024-09-21T07:07:57.652924+0000","last_active":"2024-09-21T07:07:31.529868+0000","last_peered":"2024-09-21T07:07:31.529868+0000","last_clean":"2024-09-21T07:07:31.529868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:07:32.545905+0000","last_undegraded":"2024-09-21T07:07:32.545905+0000","last_fullsized":"2024-09-21T07:07:32.545905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.686559+0000","last_change":"2024-09-21T07:07:57.686466+0000","last_active":"2024-09-21T07:07:57.686559+0000","last_peered":"2024-09-21T07:07:57.686559+0000","last_clean":"2024-09-21T07:07:57.686559+0000","last_became_active":"2024-09-21T07:07:57.671977+0000","last_became_peered":"2024-09-21T07:07:57.671977+0000","last_unstale":"2024-09-21T07:07:57.686559+0000","last_undegraded":"2024-09-21T07:07:57.686559+0000","last_fullsized":"2024-09-21T07:07:57.686559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:26.134854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:41.612579+0000","last_change":"2024-09-21T07:07:30.539941+0000","last_active":"2024-09-21T07:07:41.612579+0000","last_peered":"2024-09-21T07:07:41.612579+0000","last_clean":"2024-09-21T07:07:41.612579+0000","last_became_active":"2024-09-21T07:07:30.539401+0000","last_became_peered":"2024-09-21T07:07:30.539401+0000","last_unstale":"2024-09-21T07:07:41.612579+0000","last_undegraded":"2024-09-21T07:07:41.612579+0000","last_fullsized":"2024-09-21T07:07:41.612579+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:15.184453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573819+0000","last_change":"2024-09-21T07:07:32.556958+0000","last_active":"2024-09-21T07:07:33.573819+0000","last_peered":"2024-09-21T07:07:33.573819+0000","last_clean":"2024-09-21T07:07:33.573819+0000","last_became_active":"2024-09-21T07:07:32.556581+0000","last_became_peered":"2024-09-21T07:07:32.556581+0000","last_unstale":"2024-09-21T07:07:33.573819+0000","last_undegraded":"2024-09-21T07:07:33.573819+0000","last_fullsized":"2024-09-21T07:07:33.573819+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:57.618263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.630774+0000","last_change":"2024-09-21T07:07:30.547760+0000","last_active":"2024-09-21T07:07:43.630774+0000","last_peered":"2024-09-21T07:07:43.630774+0000","last_clean":"2024-09-21T07:07:43.630774+0000","last_became_active":"2024-09-21T07:07:30.547327+0000","last_became_peered":"2024-09-21T07:07:30.547327+0000","last_unstale":"2024-09-21T07:07:43.630774+0000","last_undegraded":"2024-09-21T07:07:43.630774+0000","last_fullsized":"2024-09-21T07:07:43.630774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:01.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.662668+0000","last_change":"2024-09-21T07:07:32.552691+0000","last_active":"2024-09-21T07:07:56.662668+0000","last_peered":"2024-09-21T07:07:56.662668+0000","last_clean":"2024-09-21T07:07:56.662668+0000","last_became_active":"2024-09-21T07:07:32.552321+0000","last_became_peered":"2024-09-21T07:07:32.552321+0000","last_unstale":"2024-09-21T07:07:56.662668+0000","last_undegraded":"2024-09-21T07:07:56.662668+0000","last_fullsized":"2024-09-21T07:07:56.662668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:56.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:58.658342+0000","last_change":"2024-09-21T07:07:30.545281+0000","last_active":"2024-09-21T07:07:58.658342+0000","last_peered":"2024-09-21T07:07:58.658342+0000","last_clean":"2024-09-21T07:07:58.658342+0000","last_became_active":"2024-09-21T07:07:30.544823+0000","last_became_peered":"2024-09-21T07:07:30.544823+0000","last_unstale":"2024-09-21T07:07:58.658342+0000","last_undegraded":"2024-09-21T07:07:58.658342+0000","last_fullsized":"2024-09-21T07:07:58.658342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.659421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.664484+0000","last_change":"2024-09-21T07:07:32.567833+0000","last_active":"2024-09-21T07:07:56.664484+0000","last_peered":"2024-09-21T07:07:56.664484+0000","last_clean":"2024-09-21T07:07:56.664484+0000","last_became_active":"2024-09-21T07:07:32.566902+0000","last_became_peered":"2024-09-21T07:07:32.566902+0000","last_unstale":"2024-09-21T07:07:56.664484+0000","last_undegraded":"2024-09-21T07:07:56.664484+0000","last_fullsized":"2024-09-21T07:07:56.664484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.871038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.628135+0000","last_change":"2024-09-21T07:07:30.546031+0000","last_active":"2024-09-21T07:07:43.628135+0000","last_peered":"2024-09-21T07:07:43.628135+0000","last_clean":"2024-09-21T07:07:43.628135+0000","last_became_active":"2024-09-21T07:07:30.545658+0000","last_became_peered":"2024-09-21T07:07:30.545658+0000","last_unstale":"2024-09-21T07:07:43.628135+0000","last_undegraded":"2024-09-21T07:07:43.628135+0000","last_fullsized":"2024-09-21T07:07:43.628135+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:20.359374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574873+0000","last_change":"2024-09-21T07:07:32.561445+0000","last_active":"2024-09-21T07:07:33.574873+0000","last_peered":"2024-09-21T07:07:33.574873+0000","last_clean":"2024-09-21T07:07:33.574873+0000","last_became_active":"2024-09-21T07:07:32.561033+0000","last_became_peered":"2024-09-21T07:07:32.561033+0000","last_unstale":"2024-09-21T07:07:33.574873+0000","last_undegraded":"2024-09-21T07:07:33.574873+0000","last_fullsized":"2024-09-21T07:07:33.574873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:30.261234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:42.621920+0000","last_change":"2024-09-21T07:07:30.755110+0000","last_active":"2024-09-21T07:07:42.621920+0000","last_peered":"2024-09-21T07:07:42.621920+0000","last_clean":"2024-09-21T07:07:42.621920+0000","last_became_active":"2024-09-21T07:07:30.754680+0000","last_became_peered":"2024-09-21T07:07:30.754680+0000","last_unstale":"2024-09-21T07:07:42.621920+0000","last_undegraded":"2024-09-21T07:07:42.621920+0000","last_fullsized":"2024-09-21T07:07:42.621920+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.202010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665839+0000","last_change":"2024-09-21T07:07:32.557349+0000","last_active":"2024-09-21T07:07:56.665839+0000","last_peered":"2024-09-21T07:07:56.665839+0000","last_clean":"2024-09-21T07:07:56.665839+0000","last_became_active":"2024-09-21T07:07:32.554342+0000","last_became_peered":"2024-09-21T07:07:32.554342+0000","last_unstale":"2024-09-21T07:07:56.665839+0000","last_undegraded":"2024-09-21T07:07:56.665839+0000","last_fullsized":"2024-09-21T07:07:56.665839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:21.356410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:58.661721+0000","last_change":"2024-09-21T07:07:30.547691+0000","last_active":"2024-09-21T07:07:58.661721+0000","last_peered":"2024-09-21T07:07:58.661721+0000","last_clean":"2024-09-21T07:07:58.661721+0000","last_became_active":"2024-09-21T07:07:30.547280+0000","last_became_peered":"2024-09-21T07:07:30.547280+0000","last_unstale":"2024-09-21T07:07:58.661721+0000","last_undegraded":"2024-09-21T07:07:58.661721+0000","last_fullsized":"2024-09-21T07:07:58.661721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:24.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62769,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":70,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.668576+0000","last_change":"2024-09-21T07:07:32.569291+0000","last_active":"2024-09-21T07:07:56.668576+0000","last_peered":"2024-09-21T07:07:56.668576+0000","last_clean":"2024-09-21T07:07:56.668576+0000","last_became_active":"2024-09-21T07:07:32.568503+0000","last_became_peered":"2024-09-21T07:07:32.568503+0000","last_unstale":"2024-09-21T07:07:56.668576+0000","last_undegraded":"2024-09-21T07:07:56.668576+0000","last_fullsized":"2024-09-21T07:07:56.668576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:56.184795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669620+0000","last_change":"2024-09-21T07:07:30.546624+0000","last_active":"2024-09-21T07:07:57.669620+0000","last_peered":"2024-09-21T07:07:57.669620+0000","last_clean":"2024-09-21T07:07:57.669620+0000","last_became_active":"2024-09-21T07:07:30.545497+0000","last_became_peered":"2024-09-21T07:07:30.545497+0000","last_unstale":"2024-09-21T07:07:57.669620+0000","last_undegraded":"2024-09-21T07:07:57.669620+0000","last_fullsized":"2024-09-21T07:07:57.669620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.963089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564151+0000","last_change":"2024-09-21T07:07:32.551123+0000","last_active":"2024-09-21T07:07:33.564151+0000","last_peered":"2024-09-21T07:07:33.564151+0000","last_clean":"2024-09-21T07:07:33.564151+0000","last_became_active":"2024-09-21T07:07:32.550423+0000","last_became_peered":"2024-09-21T07:07:32.550423+0000","last_unstale":"2024-09-21T07:07:33.564151+0000","last_undegraded":"2024-09-21T07:07:33.564151+0000","last_fullsized":"2024-09-21T07:07:33.564151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:00.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.630375+0000","last_change":"2024-09-21T07:07:30.550102+0000","last_active":"2024-09-21T07:07:43.630375+0000","last_peered":"2024-09-21T07:07:43.630375+0000","last_clean":"2024-09-21T07:07:43.630375+0000","last_became_active":"2024-09-21T07:07:30.549609+0000","last_became_peered":"2024-09-21T07:07:30.549609+0000","last_unstale":"2024-09-21T07:07:43.630375+0000","last_undegraded":"2024-09-21T07:07:43.630375+0000","last_fullsized":"2024-09-21T07:07:43.630375+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:58.587612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573964+0000","last_change":"2024-09-21T07:07:32.556167+0000","last_active":"2024-09-21T07:07:33.573964+0000","last_peered":"2024-09-21T07:07:33.573964+0000","last_clean":"2024-09-21T07:07:33.573964+0000","last_became_active":"2024-09-21T07:07:32.555372+0000","last_became_peered":"2024-09-21T07:07:32.555372+0000","last_unstale":"2024-09-21T07:07:33.573964+0000","last_undegraded":"2024-09-21T07:07:33.573964+0000","last_fullsized":"2024-09-21T07:07:33.573964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:35.056919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653941+0000","last_change":"2024-09-21T07:07:30.543196+0000","last_active":"2024-09-21T07:07:54.653941+0000","last_peered":"2024-09-21T07:07:54.653941+0000","last_clean":"2024-09-21T07:07:54.653941+0000","last_became_active":"2024-09-21T07:07:30.542755+0000","last_became_peered":"2024-09-21T07:07:30.542755+0000","last_unstale":"2024-09-21T07:07:54.653941+0000","last_undegraded":"2024-09-21T07:07:54.653941+0000","last_fullsized":"2024-09-21T07:07:54.653941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:14.821703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572622+0000","last_change":"2024-09-21T07:07:32.561243+0000","last_active":"2024-09-21T07:07:33.572622+0000","last_peered":"2024-09-21T07:07:33.572622+0000","last_clean":"2024-09-21T07:07:33.572622+0000","last_became_active":"2024-09-21T07:07:32.560878+0000","last_became_peered":"2024-09-21T07:07:32.560878+0000","last_unstale":"2024-09-21T07:07:33.572622+0000","last_undegraded":"2024-09-21T07:07:33.572622+0000","last_fullsized":"2024-09-21T07:07:33.572622+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:19.342422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666167+0000","last_change":"2024-09-21T07:07:30.754985+0000","last_active":"2024-09-21T07:07:56.666167+0000","last_peered":"2024-09-21T07:07:56.666167+0000","last_clean":"2024-09-21T07:07:56.666167+0000","last_became_active":"2024-09-21T07:07:30.754490+0000","last_became_peered":"2024-09-21T07:07:30.754490+0000","last_unstale":"2024-09-21T07:07:56.666167+0000","last_undegraded":"2024-09-21T07:07:56.666167+0000","last_fullsized":"2024-09-21T07:07:56.666167+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:21.645643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565523+0000","last_change":"2024-09-21T07:07:32.567997+0000","last_active":"2024-09-21T07:07:33.565523+0000","last_peered":"2024-09-21T07:07:33.565523+0000","last_clean":"2024-09-21T07:07:33.565523+0000","last_became_active":"2024-09-21T07:07:32.567314+0000","last_became_peered":"2024-09-21T07:07:32.567314+0000","last_unstale":"2024-09-21T07:07:33.565523+0000","last_undegraded":"2024-09-21T07:07:33.565523+0000","last_fullsized":"2024-09-21T07:07:33.565523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:07.741967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.678889+0000","last_change":"2024-09-21T07:07:57.678175+0000","last_active":"2024-09-21T07:07:57.678889+0000","last_peered":"2024-09-21T07:07:57.678889+0000","last_clean":"2024-09-21T07:07:57.678889+0000","last_became_active":"2024-09-21T07:07:57.671137+0000","last_became_peered":"2024-09-21T07:07:57.671137+0000","last_unstale":"2024-09-21T07:07:57.678889+0000","last_undegraded":"2024-09-21T07:07:57.678889+0000","last_fullsized":"2024-09-21T07:07:57.678889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664423+0000","last_change":"2024-09-21T07:07:32.563380+0000","last_active":"2024-09-21T07:07:57.664423+0000","last_peered":"2024-09-21T07:07:57.664423+0000","last_clean":"2024-09-21T07:07:57.664423+0000","last_became_active":"2024-09-21T07:07:32.563012+0000","last_became_peered":"2024-09-21T07:07:32.563012+0000","last_unstale":"2024-09-21T07:07:57.664423+0000","last_undegraded":"2024-09-21T07:07:57.664423+0000","last_fullsized":"2024-09-21T07:07:57.664423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.627703+0000","last_change":"2024-09-21T07:07:30.546448+0000","last_active":"2024-09-21T07:07:43.627703+0000","last_peered":"2024-09-21T07:07:43.627703+0000","last_clean":"2024-09-21T07:07:43.627703+0000","last_became_active":"2024-09-21T07:07:30.546015+0000","last_became_peered":"2024-09-21T07:07:30.546015+0000","last_unstale":"2024-09-21T07:07:43.627703+0000","last_undegraded":"2024-09-21T07:07:43.627703+0000","last_fullsized":"2024-09-21T07:07:43.627703+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:23.041651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572538+0000","last_change":"2024-09-21T07:07:32.562533+0000","last_active":"2024-09-21T07:07:33.572538+0000","last_peered":"2024-09-21T07:07:33.572538+0000","last_clean":"2024-09-21T07:07:33.572538+0000","last_became_active":"2024-09-21T07:07:32.562101+0000","last_became_peered":"2024-09-21T07:07:32.562101+0000","last_unstale":"2024-09-21T07:07:33.572538+0000","last_undegraded":"2024-09-21T07:07:33.572538+0000","last_fullsized":"2024-09-21T07:07:33.572538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:49.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.629665+0000","last_change":"2024-09-21T07:07:30.547263+0000","last_active":"2024-09-21T07:07:43.629665+0000","last_peered":"2024-09-21T07:07:43.629665+0000","last_clean":"2024-09-21T07:07:43.629665+0000","last_became_active":"2024-09-21T07:07:30.546874+0000","last_became_peered":"2024-09-21T07:07:30.546874+0000","last_unstale":"2024-09-21T07:07:43.629665+0000","last_undegraded":"2024-09-21T07:07:43.629665+0000","last_fullsized":"2024-09-21T07:07:43.629665+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:18.545407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575642+0000","last_change":"2024-09-21T07:07:32.560288+0000","last_active":"2024-09-21T07:07:33.575642+0000","last_peered":"2024-09-21T07:07:33.575642+0000","last_clean":"2024-09-21T07:07:33.575642+0000","last_became_active":"2024-09-21T07:07:32.559938+0000","last_became_peered":"2024-09-21T07:07:32.559938+0000","last_unstale":"2024-09-21T07:07:33.575642+0000","last_undegraded":"2024-09-21T07:07:33.575642+0000","last_fullsized":"2024-09-21T07:07:33.575642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:55.531828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.672285+0000","last_change":"2024-09-21T07:07:30.754602+0000","last_active":"2024-09-21T07:07:57.672285+0000","last_peered":"2024-09-21T07:07:57.672285+0000","last_clean":"2024-09-21T07:07:57.672285+0000","last_became_active":"2024-09-21T07:07:30.754159+0000","last_became_peered":"2024-09-21T07:07:30.754159+0000","last_unstale":"2024-09-21T07:07:57.672285+0000","last_undegraded":"2024-09-21T07:07:57.672285+0000","last_fullsized":"2024-09-21T07:07:57.672285+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.575056+0000","last_change":"2024-09-21T07:07:32.557819+0000","last_active":"2024-09-21T07:07:33.575056+0000","last_peered":"2024-09-21T07:07:33.575056+0000","last_clean":"2024-09-21T07:07:33.575056+0000","last_became_active":"2024-09-21T07:07:32.557363+0000","last_became_peered":"2024-09-21T07:07:32.557363+0000","last_unstale":"2024-09-21T07:07:33.575056+0000","last_undegraded":"2024-09-21T07:07:33.575056+0000","last_fullsized":"2024-09-21T07:07:33.575056+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.802658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":92,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572574+0000","last_change":"2024-09-21T07:06:20.138629+0000","last_active":"2024-09-21T07:07:33.572574+0000","last_peered":"2024-09-21T07:07:33.572574+0000","last_clean":"2024-09-21T07:07:33.572574+0000","last_became_active":"2024-09-21T07:06:20.132041+0000","last_became_peered":"2024-09-21T07:06:20.132041+0000","last_unstale":"2024-09-21T07:07:33.572574+0000","last_undegraded":"2024-09-21T07:07:33.572574+0000","last_fullsized":"2024-09-21T07:07:33.572574+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_clean_scrub_stamp":"2024-09-21T07:02:52.790893+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:41.784916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:44.633409+0000","last_change":"2024-09-21T07:07:30.541638+0000","last_active":"2024-09-21T07:07:44.633409+0000","last_peered":"2024-09-21T07:07:44.633409+0000","last_clean":"2024-09-21T07:07:44.633409+0000","last_became_active":"2024-09-21T07:07:30.541185+0000","last_became_peered":"2024-09-21T07:07:30.541185+0000","last_unstale":"2024-09-21T07:07:44.633409+0000","last_undegraded":"2024-09-21T07:07:44.633409+0000","last_fullsized":"2024-09-21T07:07:44.633409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:15.837077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573556+0000","last_change":"2024-09-21T07:07:32.560817+0000","last_active":"2024-09-21T07:07:33.573556+0000","last_peered":"2024-09-21T07:07:33.573556+0000","last_clean":"2024-09-21T07:07:33.573556+0000","last_became_active":"2024-09-21T07:07:32.560269+0000","last_became_peered":"2024-09-21T07:07:32.560269+0000","last_unstale":"2024-09-21T07:07:33.573556+0000","last_undegraded":"2024-09-21T07:07:33.573556+0000","last_fullsized":"2024-09-21T07:07:33.573556+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:40.109644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:41.612838+0000","last_change":"2024-09-21T07:07:30.543936+0000","last_active":"2024-09-21T07:07:41.612838+0000","last_peered":"2024-09-21T07:07:41.612838+0000","last_clean":"2024-09-21T07:07:41.612838+0000","last_became_active":"2024-09-21T07:07:30.543530+0000","last_became_peered":"2024-09-21T07:07:30.543530+0000","last_unstale":"2024-09-21T07:07:41.612838+0000","last_undegraded":"2024-09-21T07:07:41.612838+0000","last_fullsized":"2024-09-21T07:07:41.612838+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:02.312471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564094+0000","last_change":"2024-09-21T07:07:32.542182+0000","last_active":"2024-09-21T07:07:33.564094+0000","last_peered":"2024-09-21T07:07:33.564094+0000","last_clean":"2024-09-21T07:07:33.564094+0000","last_became_active":"2024-09-21T07:07:32.541750+0000","last_became_peered":"2024-09-21T07:07:32.541750+0000","last_unstale":"2024-09-21T07:07:33.564094+0000","last_undegraded":"2024-09-21T07:07:33.564094+0000","last_fullsized":"2024-09-21T07:07:33.564094+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.184712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.653368+0000","last_change":"2024-09-21T07:07:30.754978+0000","last_active":"2024-09-21T07:07:54.653368+0000","last_peered":"2024-09-21T07:07:54.653368+0000","last_clean":"2024-09-21T07:07:54.653368+0000","last_became_active":"2024-09-21T07:07:30.754149+0000","last_became_peered":"2024-09-21T07:07:30.754149+0000","last_unstale":"2024-09-21T07:07:54.653368+0000","last_undegraded":"2024-09-21T07:07:54.653368+0000","last_fullsized":"2024-09-21T07:07:54.653368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:36.140237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565483+0000","last_change":"2024-09-21T07:07:32.570424+0000","last_active":"2024-09-21T07:07:33.565483+0000","last_peered":"2024-09-21T07:07:33.565483+0000","last_clean":"2024-09-21T07:07:33.565483+0000","last_became_active":"2024-09-21T07:07:32.570029+0000","last_became_peered":"2024-09-21T07:07:32.570029+0000","last_unstale":"2024-09-21T07:07:33.565483+0000","last_undegraded":"2024-09-21T07:07:33.565483+0000","last_fullsized":"2024-09-21T07:07:33.565483+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:09.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:54.652840+0000","last_change":"2024-09-21T07:07:30.543963+0000","last_active":"2024-09-21T07:07:54.652840+0000","last_peered":"2024-09-21T07:07:54.652840+0000","last_clean":"2024-09-21T07:07:54.652840+0000","last_became_active":"2024-09-21T07:07:30.543586+0000","last_became_peered":"2024-09-21T07:07:30.543586+0000","last_unstale":"2024-09-21T07:07:54.652840+0000","last_undegraded":"2024-09-21T07:07:54.652840+0000","last_fullsized":"2024-09-21T07:07:54.652840+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:05.782005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662307+0000","last_change":"2024-09-21T07:07:32.556132+0000","last_active":"2024-09-21T07:07:57.662307+0000","last_peered":"2024-09-21T07:07:57.662307+0000","last_clean":"2024-09-21T07:07:57.662307+0000","last_became_active":"2024-09-21T07:07:32.555717+0000","last_became_peered":"2024-09-21T07:07:32.555717+0000","last_unstale":"2024-09-21T07:07:57.662307+0000","last_undegraded":"2024-09-21T07:07:57.662307+0000","last_fullsized":"2024-09-21T07:07:57.662307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.809268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663009+0000","last_change":"2024-09-21T07:07:30.755143+0000","last_active":"2024-09-21T07:07:56.663009+0000","last_peered":"2024-09-21T07:07:56.663009+0000","last_clean":"2024-09-21T07:07:56.663009+0000","last_became_active":"2024-09-21T07:07:30.754591+0000","last_became_peered":"2024-09-21T07:07:30.754591+0000","last_unstale":"2024-09-21T07:07:56.663009+0000","last_undegraded":"2024-09-21T07:07:56.663009+0000","last_fullsized":"2024-09-21T07:07:56.663009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:13.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662201+0000","last_change":"2024-09-21T07:07:32.552869+0000","last_active":"2024-09-21T07:07:57.662201+0000","last_peered":"2024-09-21T07:07:57.662201+0000","last_clean":"2024-09-21T07:07:57.662201+0000","last_became_active":"2024-09-21T07:07:32.552483+0000","last_became_peered":"2024-09-21T07:07:32.552483+0000","last_unstale":"2024-09-21T07:07:57.662201+0000","last_undegraded":"2024-09-21T07:07:57.662201+0000","last_fullsized":"2024-09-21T07:07:57.662201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:21.006847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.669000+0000","last_change":"2024-09-21T07:07:30.755552+0000","last_active":"2024-09-21T07:07:56.669000+0000","last_peered":"2024-09-21T07:07:56.669000+0000","last_clean":"2024-09-21T07:07:56.669000+0000","last_became_active":"2024-09-21T07:07:30.754451+0000","last_became_peered":"2024-09-21T07:07:30.754451+0000","last_unstale":"2024-09-21T07:07:56.669000+0000","last_undegraded":"2024-09-21T07:07:56.669000+0000","last_fullsized":"2024-09-21T07:07:56.669000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:50.229649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.564719+0000","last_change":"2024-09-21T07:07:32.543249+0000","last_active":"2024-09-21T07:07:33.564719+0000","last_peered":"2024-09-21T07:07:33.564719+0000","last_clean":"2024-09-21T07:07:33.564719+0000","last_became_active":"2024-09-21T07:07:32.542866+0000","last_became_peered":"2024-09-21T07:07:32.542866+0000","last_unstale":"2024-09-21T07:07:33.564719+0000","last_undegraded":"2024-09-21T07:07:33.564719+0000","last_fullsized":"2024-09-21T07:07:33.564719+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:29.476454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'15","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663256+0000","last_change":"2024-09-21T07:07:30.541589+0000","last_active":"2024-09-21T07:07:56.663256+0000","last_peered":"2024-09-21T07:07:56.663256+0000","last_clean":"2024-09-21T07:07:56.663256+0000","last_became_active":"2024-09-21T07:07:30.541171+0000","last_became_peered":"2024-09-21T07:07:30.541171+0000","last_unstale":"2024-09-21T07:07:56.663256+0000","last_undegraded":"2024-09-21T07:07:56.663256+0000","last_fullsized":"2024-09-21T07:07:56.663256+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:46.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574294+0000","last_change":"2024-09-21T07:07:32.558409+0000","last_active":"2024-09-21T07:07:33.574294+0000","last_peered":"2024-09-21T07:07:33.574294+0000","last_clean":"2024-09-21T07:07:33.574294+0000","last_became_active":"2024-09-21T07:07:32.557886+0000","last_became_peered":"2024-09-21T07:07:32.557886+0000","last_unstale":"2024-09-21T07:07:33.574294+0000","last_undegraded":"2024-09-21T07:07:33.574294+0000","last_fullsized":"2024-09-21T07:07:33.574294+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.071651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.628769+0000","last_change":"2024-09-21T07:07:30.536107+0000","last_active":"2024-09-21T07:07:43.628769+0000","last_peered":"2024-09-21T07:07:43.628769+0000","last_clean":"2024-09-21T07:07:43.628769+0000","last_became_active":"2024-09-21T07:07:30.535455+0000","last_became_peered":"2024-09-21T07:07:30.535455+0000","last_unstale":"2024-09-21T07:07:43.628769+0000","last_undegraded":"2024-09-21T07:07:43.628769+0000","last_fullsized":"2024-09-21T07:07:43.628769+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:55.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572308+0000","last_change":"2024-09-21T07:07:32.553187+0000","last_active":"2024-09-21T07:07:33.572308+0000","last_peered":"2024-09-21T07:07:33.572308+0000","last_clean":"2024-09-21T07:07:33.572308+0000","last_became_active":"2024-09-21T07:07:32.552905+0000","last_became_peered":"2024-09-21T07:07:32.552905+0000","last_unstale":"2024-09-21T07:07:33.572308+0000","last_undegraded":"2024-09-21T07:07:33.572308+0000","last_fullsized":"2024-09-21T07:07:33.572308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:24.790329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665358+0000","last_change":"2024-09-21T07:07:30.754858+0000","last_active":"2024-09-21T07:07:56.665358+0000","last_peered":"2024-09-21T07:07:56.665358+0000","last_clean":"2024-09-21T07:07:56.665358+0000","last_became_active":"2024-09-21T07:07:30.754483+0000","last_became_peered":"2024-09-21T07:07:30.754483+0000","last_unstale":"2024-09-21T07:07:56.665358+0000","last_undegraded":"2024-09-21T07:07:56.665358+0000","last_fullsized":"2024-09-21T07:07:56.665358+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:29.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666429+0000","last_change":"2024-09-21T07:07:32.562213+0000","last_active":"2024-09-21T07:07:56.666429+0000","last_peered":"2024-09-21T07:07:56.666429+0000","last_clean":"2024-09-21T07:07:56.666429+0000","last_became_active":"2024-09-21T07:07:32.561834+0000","last_became_peered":"2024-09-21T07:07:32.561834+0000","last_unstale":"2024-09-21T07:07:56.666429+0000","last_undegraded":"2024-09-21T07:07:56.666429+0000","last_fullsized":"2024-09-21T07:07:56.666429+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:12.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:43.627147+0000","last_change":"2024-09-21T07:07:30.543455+0000","last_active":"2024-09-21T07:07:43.627147+0000","last_peered":"2024-09-21T07:07:43.627147+0000","last_clean":"2024-09-21T07:07:43.627147+0000","last_became_active":"2024-09-21T07:07:30.543059+0000","last_became_peered":"2024-09-21T07:07:30.543059+0000","last_unstale":"2024-09-21T07:07:43.627147+0000","last_undegraded":"2024-09-21T07:07:43.627147+0000","last_fullsized":"2024-09-21T07:07:43.627147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.896121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664245+0000","last_change":"2024-09-21T07:07:32.560600+0000","last_active":"2024-09-21T07:07:57.664245+0000","last_peered":"2024-09-21T07:07:57.664245+0000","last_clean":"2024-09-21T07:07:57.664245+0000","last_became_active":"2024-09-21T07:07:32.560159+0000","last_became_peered":"2024-09-21T07:07:32.560159+0000","last_unstale":"2024-09-21T07:07:57.664245+0000","last_undegraded":"2024-09-21T07:07:57.664245+0000","last_fullsized":"2024-09-21T07:07:57.664245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.228180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.683341+0000","last_change":"2024-09-21T07:07:57.682685+0000","last_active":"2024-09-21T07:07:57.683341+0000","last_peered":"2024-09-21T07:07:57.683341+0000","last_clean":"2024-09-21T07:07:57.683341+0000","last_became_active":"2024-09-21T07:07:57.671259+0000","last_became_peered":"2024-09-21T07:07:57.671259+0000","last_unstale":"2024-09-21T07:07:57.683341+0000","last_undegraded":"2024-09-21T07:07:57.683341+0000","last_fullsized":"2024-09-21T07:07:57.683341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.573373+0000","last_change":"2024-09-21T07:07:32.554033+0000","last_active":"2024-09-21T07:07:33.573373+0000","last_peered":"2024-09-21T07:07:33.573373+0000","last_clean":"2024-09-21T07:07:33.573373+0000","last_became_active":"2024-09-21T07:07:32.553654+0000","last_became_peered":"2024-09-21T07:07:32.553654+0000","last_unstale":"2024-09-21T07:07:33.573373+0000","last_undegraded":"2024-09-21T07:07:33.573373+0000","last_fullsized":"2024-09-21T07:07:33.573373+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:15.876104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.666978+0000","last_change":"2024-09-21T07:07:30.547818+0000","last_active":"2024-09-21T07:07:56.666978+0000","last_peered":"2024-09-21T07:07:56.666978+0000","last_clean":"2024-09-21T07:07:56.666978+0000","last_became_active":"2024-09-21T07:07:30.547387+0000","last_became_peered":"2024-09-21T07:07:30.547387+0000","last_unstale":"2024-09-21T07:07:56.666978+0000","last_undegraded":"2024-09-21T07:07:56.666978+0000","last_fullsized":"2024-09-21T07:07:56.666978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.572574+0000","last_change":"2024-09-21T07:07:32.566731+0000","last_active":"2024-09-21T07:07:33.572574+0000","last_peered":"2024-09-21T07:07:33.572574+0000","last_clean":"2024-09-21T07:07:33.572574+0000","last_became_active":"2024-09-21T07:07:32.566233+0000","last_became_peered":"2024-09-21T07:07:32.566233+0000","last_unstale":"2024-09-21T07:07:33.572574+0000","last_undegraded":"2024-09-21T07:07:33.572574+0000","last_fullsized":"2024-09-21T07:07:33.572574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:57.630088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.565418+0000","last_change":"2024-09-21T07:07:32.570224+0000","last_active":"2024-09-21T07:07:33.565418+0000","last_peered":"2024-09-21T07:07:33.565418+0000","last_clean":"2024-09-21T07:07:33.565418+0000","last_became_active":"2024-09-21T07:07:32.569847+0000","last_became_peered":"2024-09-21T07:07:32.569847+0000","last_unstale":"2024-09-21T07:07:33.565418+0000","last_undegraded":"2024-09-21T07:07:33.565418+0000","last_fullsized":"2024-09-21T07:07:33.565418+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:44.565390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.668041+0000","last_change":"2024-09-21T07:07:30.544884+0000","last_active":"2024-09-21T07:07:56.668041+0000","last_peered":"2024-09-21T07:07:56.668041+0000","last_clean":"2024-09-21T07:07:56.668041+0000","last_became_active":"2024-09-21T07:07:30.543321+0000","last_became_peered":"2024-09-21T07:07:30.543321+0000","last_unstale":"2024-09-21T07:07:56.668041+0000","last_undegraded":"2024-09-21T07:07:56.668041+0000","last_fullsized":"2024-09-21T07:07:56.668041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.234905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.665654+0000","last_change":"2024-09-21T07:07:32.566124+0000","last_active":"2024-09-21T07:07:56.665654+0000","last_peered":"2024-09-21T07:07:56.665654+0000","last_clean":"2024-09-21T07:07:56.665654+0000","last_became_active":"2024-09-21T07:07:32.565743+0000","last_became_peered":"2024-09-21T07:07:32.565743+0000","last_unstale":"2024-09-21T07:07:56.665654+0000","last_undegraded":"2024-09-21T07:07:56.665654+0000","last_fullsized":"2024-09-21T07:07:56.665654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:57.048529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.669538+0000","last_change":"2024-09-21T07:07:30.546742+0000","last_active":"2024-09-21T07:07:56.669538+0000","last_peered":"2024-09-21T07:07:56.669538+0000","last_clean":"2024-09-21T07:07:56.669538+0000","last_became_active":"2024-09-21T07:07:30.546300+0000","last_became_peered":"2024-09-21T07:07:30.546300+0000","last_unstale":"2024-09-21T07:07:56.669538+0000","last_undegraded":"2024-09-21T07:07:56.669538+0000","last_fullsized":"2024-09-21T07:07:56.669538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:58.903582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574773+0000","last_change":"2024-09-21T07:07:32.565602+0000","last_active":"2024-09-21T07:07:33.574773+0000","last_peered":"2024-09-21T07:07:33.574773+0000","last_clean":"2024-09-21T07:07:33.574773+0000","last_became_active":"2024-09-21T07:07:32.565252+0000","last_became_peered":"2024-09-21T07:07:32.565252+0000","last_unstale":"2024-09-21T07:07:33.574773+0000","last_undegraded":"2024-09-21T07:07:33.574773+0000","last_fullsized":"2024-09-21T07:07:33.574773+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:50.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.579859+0000","last_change":"2024-09-21T07:07:30.754535+0000","last_active":"2024-09-21T07:07:33.579859+0000","last_peered":"2024-09-21T07:07:33.579859+0000","last_clean":"2024-09-21T07:07:33.579859+0000","last_became_active":"2024-09-21T07:07:30.754129+0000","last_became_peered":"2024-09-21T07:07:30.754129+0000","last_unstale":"2024-09-21T07:07:33.579859+0000","last_undegraded":"2024-09-21T07:07:33.579859+0000","last_fullsized":"2024-09-21T07:07:33.579859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:23.800713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-21T07:07:33.574580+0000","last_change":"2024-09-21T07:07:32.561210+0000","last_active":"2024-09-21T07:07:33.574580+0000","last_peered":"2024-09-21T07:07:33.574580+0000","last_clean":"2024-09-21T07:07:33.574580+0000","last_became_active":"2024-09-21T07:07:32.560850+0000","last_became_peered":"2024-09-21T07:07:32.560850+0000","last_unstale":"2024-09-21T07:07:33.574580+0000","last_undegraded":"2024-09-21T07:07:33.574580+0000","last_fullsized":"2024-09-21T07:07:33.574580+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.212097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T07:07:56.663194+0000","last_change":"2024-09-21T07:07:30.543778+0000","last_active":"2024-09-21T07:07:56.663194+0000","last_peered":"2024-09-21T07:07:56.663194+0000","last_clean":"2024-09-21T07:07:56.663194+0000","last_became_active":"2024-09-21T07:07:30.543474+0000","last_became_peered":"2024-09-21T07:07:30.543474+0000","last_unstale":"2024-09-21T07:07:56.663194+0000","last_undegraded":"2024-09-21T07:07:56.663194+0000","last_fullsized":"2024-09-21T07:07:56.663194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:06.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70364,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":242,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":194086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808850,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":395386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40992,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704160,"statfs":{"total":95995035648,"available":95953059840,"internally_reserved":0,"allocated":1515520,"data_stored":1040648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135899,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":386444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":378179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528358,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28404,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716748,"statfs":{"total":95995035648,"available":95965949952,"internally_reserved":0,"allocated":1413120,"data_stored":971088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888112,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716736,"statfs":{"total":95995035648,"available":95965937664,"internally_reserved":0,"allocated":1425408,"data_stored":969984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36128,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709024,"statfs":{"total":95995035648,"available":95958040576,"internally_reserved":0,"allocated":802816,"data_stored":377770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":377343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":441940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":872448,"data_stored":441720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40308,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704844,"statfs":{"total":95995035648,"available":95953760256,"internally_reserved":0,"allocated":823296,"data_stored":379248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:08:02.795 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-21T07:08:02.796 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 74, 'state': 'peering', 'last_fresh': '2024-09-21T07:07:32.545905+0000', 'last_change': '2024-09-21T07:07:57.652924+0000', 'last_active': '2024-09-21T07:07:31.529868+0000', 'last_peered': '2024-09-21T07:07:31.529868+0000', 'last_clean': '2024-09-21T07:07:31.529868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:07:32.545905+0000', 'last_undegraded': '2024-09-21T07:07:32.545905+0000', 'last_fullsized': '2024-09-21T07:07:32.545905+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 71, 'last_epoch_clean': 72, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:07:31.529868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:07:31.529868+0000', 'last_clean_scrub_stamp': '2024-09-21T07:07:31.529868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [9, 4, 3], 'acting': [9, 4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 9, 'acting_primary': 9, 'purged_snaps': []} 2024-09-21T07:08:02.796 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph status --format=json 2024-09-21T07:08:03.071 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.597+0000 7faed739d640 1 -- 172.21.15.29:0/4931251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 msgr2=0x7faed010ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.597+0000 7faed739d640 1 --2- 172.21.15.29:0/4931251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed010ead0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faec8009ca0 tx=0x7faec802a8d0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.597+0000 7faed739d640 1 -- 172.21.15.29:0/4931251 shutdown_connections 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.597+0000 7faed739d640 1 --2- 172.21.15.29:0/4931251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed010ead0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.597+0000 7faed739d640 1 --2- 172.21.15.29:0/4931251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed0107950 0x7faed0107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.597+0000 7faed739d640 1 --2- 172.21.15.29:0/4931251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed0102010 0x7faed0102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.598+0000 7faed739d640 1 -- 172.21.15.29:0/4931251 >> 172.21.15.29:0/4931251 conn(0x7faed0077aa0 msgr2=0x7faed0077ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.598+0000 7faed739d640 1 -- 172.21.15.29:0/4931251 shutdown_connections 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.598+0000 7faed739d640 1 -- 172.21.15.29:0/4931251 wait complete. 2024-09-21T07:08:03.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.598+0000 7faed739d640 1 Processor -- start 2024-09-21T07:08:03.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.598+0000 7faed739d640 1 -- start start 2024-09-21T07:08:03.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed739d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed0102010 0x7faed019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:03.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed739d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed0107950 0x7faed019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:03.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed739d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:03.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed739d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7faed0112020 con 0x7faed01082a0 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed739d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faed0111ea0 con 0x7faed0107950 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed739d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faed01121a0 con 0x7faed0102010 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50392/0 (socket says 172.21.15.29:50392) 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 -- 172.21.15.29:0/2028569662 learned_addr learned my addr 172.21.15.29:0/2028569662 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed639b640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed0102010 0x7faed019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed5b9a640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed0107950 0x7faed019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 -- 172.21.15.29:0/2028569662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed0102010 msgr2=0x7faed019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed0102010 0x7faed019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 -- 172.21.15.29:0/2028569662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed0107950 msgr2=0x7faed019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed0107950 0x7faed019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 -- 172.21.15.29:0/2028569662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed01a0340 con 0x7faed01082a0 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed5b9a640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed0107950 0x7faed019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.599+0000 7faed6b9c640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed019fc10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faec80097b0 tx=0x7faec8031a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:03.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.600+0000 7faec77fe640 1 -- 172.21.15.29:0/2028569662 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8003bf0 con 0x7faed01082a0 2024-09-21T07:08:03.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.600+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed01a05d0 con 0x7faed01082a0 2024-09-21T07:08:03.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.600+0000 7faec77fe640 1 -- 172.21.15.29:0/2028569662 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec8003d90 con 0x7faed01082a0 2024-09-21T07:08:03.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.600+0000 7faec77fe640 1 -- 172.21.15.29:0/2028569662 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8030bb0 con 0x7faed01082a0 2024-09-21T07:08:03.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.600+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed01a6d90 con 0x7faed01082a0 2024-09-21T07:08:03.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.601+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed01024a0 con 0x7faed01082a0 2024-09-21T07:08:03.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.603+0000 7faec77fe640 1 -- 172.21.15.29:0/2028569662 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7faec80046a0 con 0x7faed01082a0 2024-09-21T07:08:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.604+0000 7faec77fe640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faebc0b6620 0x7faebc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.604+0000 7faed639b640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faebc0b6620 0x7faebc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.604+0000 7faec77fe640 1 -- 172.21.15.29:0/2028569662 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7faec8108b00 con 0x7faed01082a0 2024-09-21T07:08:03.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.605+0000 7faed639b640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faebc0b6620 0x7faebc0b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faecc009990 tx=0x7faecc009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:03.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.608+0000 7faec77fe640 1 -- 172.21.15.29:0/2028569662 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faec80cf1e0 con 0x7faed01082a0 2024-09-21T07:08:03.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.874+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7faed019b500 con 0x7faed01082a0 2024-09-21T07:08:03.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.875+0000 7faec77fe640 1 -- 172.21.15.29:0/2028569662 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3536 (secure 0 0 0) 0x7faed019b500 con 0x7faed01082a0 2024-09-21T07:08:03.878 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:03.878 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":435,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726902402,"num_in_osds":12,"osd_in_since":1726902379,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":102,"data_bytes":660966,"bytes_used":395247616,"bytes_avail":1151545180160,"bytes_total":1151940427776,"inactive_pgs_ratio":0.010309278033673763,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":2,"recovering_keys_per_sec":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":0,"read_bytes_sec":9341,"write_bytes_sec":4862,"read_op_per_sec":11,"write_op_per_sec":2},"fsmap":{"epoch":27,"btime":"2024-09-21T07:07:44:626522+0000","id":1,"up":5,"in":5,"max":5,"by_rank":[{"filesystem_id":1,"rank":4,"name":"g","status":"up:standby-replay","gid":14814},{"filesystem_id":1,"rank":3,"name":"a","status":"up:standby-replay","gid":14826},{"filesystem_id":1,"rank":2,"name":"l","status":"up:standby-replay","gid":24595},{"filesystem_id":1,"rank":1,"name":"k","status":"up:standby-replay","gid":24599},{"filesystem_id":1,"rank":0,"name":"f","status":"up:standby-replay","gid":24628},{"filesystem_id":1,"rank":4,"name":"e","status":"up:active","gid":24629},{"filesystem_id":1,"rank":3,"name":"c","status":"up:active","gid":24640},{"filesystem_id":1,"rank":2,"name":"h","status":"up:active","gid":24653},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24655},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24692}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.29:8443/"}},"servicemap":{"epoch":19,"modified":"2024-09-21T07:07:59.998159+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:08:03.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.877+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faebc0b6620 msgr2=0x7faebc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:03.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.877+0000 7faed739d640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faebc0b6620 0x7faebc0b8b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faecc009990 tx=0x7faecc009110 comp rx=0 tx=0).stop 2024-09-21T07:08:03.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 msgr2=0x7faed019fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed019fc10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faec80097b0 tx=0x7faec8031a00 comp rx=0 tx=0).stop 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 shutdown_connections 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7faebc0b6620 0x7faebc0b8b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faed01082a0 0x7faed019fc10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faed0107950 0x7faed019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 --2- 172.21.15.29:0/2028569662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed0102010 0x7faed019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 >> 172.21.15.29:0/2028569662 conn(0x7faed0077aa0 msgr2=0x7faed0108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 shutdown_connections 2024-09-21T07:08:03.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:03.878+0000 7faed739d640 1 -- 172.21.15.29:0/2028569662 wait complete. 2024-09-21T07:08:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:03 smithi052 ceph-mon[34308]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:03 smithi052 ceph-mon[34308]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s; 2 B/s, 1 objects/s recovering 2024-09-21T07:08:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:03 smithi066 ceph-mon[34793]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:03 smithi066 ceph-mon[34793]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s; 2 B/s, 1 objects/s recovering 2024-09-21T07:08:04.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:03 smithi029 ceph-mon[30983]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:04.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:03 smithi029 ceph-mon[30983]: pgmap v308: 97 pgs: 1 peering, 96 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s; 2 B/s, 1 objects/s recovering 2024-09-21T07:08:04.631 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-09-21T07:08:04.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:08:04.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:04 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2028569662' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T07:08:04.894 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:04.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:04 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2028569662' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T07:08:05.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:04 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2028569662' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T07:08:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 -- 172.21.15.29:0/489384664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc4810de90 msgr2=0x7fdc48110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/489384664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc4810de90 0x7fdc48110380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009ca0 tx=0x7fdc4002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 -- 172.21.15.29:0/489384664 shutdown_connections 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/489384664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc4810de90 0x7fdc48110380 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/489384664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc48105380 0x7fdc4810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/489384664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc48104a30 0x7fdc48104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 -- 172.21.15.29:0/489384664 >> 172.21.15.29:0/489384664 conn(0x7fdc48079770 msgr2=0x7fdc48079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 -- 172.21.15.29:0/489384664 shutdown_connections 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.339+0000 7fdc4dddf640 1 -- 172.21.15.29:0/489384664 wait complete. 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 Processor -- start 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 -- start start 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc48104a30 0x7fdc4819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc48105380 0x7fdc4819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc4810de90 0x7fdc4819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48113b10 con 0x7fdc48104a30 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48113990 con 0x7fdc48105380 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc4dddf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48113c90 con 0x7fdc4810de90 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc48104a30 0x7fdc4819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc477fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc48104a30 0x7fdc4819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50404/0 (socket says 172.21.15.29:50404) 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc477fe640 1 -- 172.21.15.29:0/2497469497 learned_addr learned my addr 172.21.15.29:0/2497469497 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc47fff640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc4810de90 0x7fdc4819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.340+0000 7fdc46ffd640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc48105380 0x7fdc4819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc477fe640 1 -- 172.21.15.29:0/2497469497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc4810de90 msgr2=0x7fdc4819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc477fe640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc4810de90 0x7fdc4819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc477fe640 1 -- 172.21.15.29:0/2497469497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc48105380 msgr2=0x7fdc4819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc477fe640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc48105380 0x7fdc4819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc477fe640 1 -- 172.21.15.29:0/2497469497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc481a0310 con 0x7fdc48104a30 2024-09-21T07:08:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc477fe640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc48104a30 0x7fdc4819a460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c970 tx=0x7fdc3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc44ff9640 1 -- 172.21.15.29:0/2497469497 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38007bb0 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc44ff9640 1 -- 172.21.15.29:0/2497469497 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc38007d50 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc481a0600 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc44ff9640 1 -- 172.21.15.29:0/2497469497 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800f450 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.341+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc481a6e20 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.342+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4806c260 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.344+0000 7fdc44ff9640 1 -- 172.21.15.29:0/2497469497 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdc38004f00 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.344+0000 7fdc44ff9640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdc300b65d0 0x7fdc300b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.344+0000 7fdc46ffd640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdc300b65d0 0x7fdc300b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.344+0000 7fdc44ff9640 1 -- 172.21.15.29:0/2497469497 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fdc380e7570 con 0x7fdc48104a30 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.345+0000 7fdc46ffd640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdc300b65d0 0x7fdc300b8ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c005e10 tx=0x7fdc3c005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.348+0000 7fdc44ff9640 1 -- 172.21.15.29:0/2497469497 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc38014030 con 0x7fdc48104a30 2024-09-21T07:08:05.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.533+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc48101d50 con 0x7fdc300b65d0 2024-09-21T07:08:05.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.539+0000 7fdc44ff9640 1 -- 172.21.15.29:0/2497469497 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258748 (secure 0 0 0) 0x7fdc48101d50 con 0x7fdc300b65d0 2024-09-21T07:08:05.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:05.543 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T07:08:05.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdc300b65d0 msgr2=0x7fdc300b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:05.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdc300b65d0 0x7fdc300b8ae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c005e10 tx=0x7fdc3c005da0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc48104a30 msgr2=0x7fdc4819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc48104a30 0x7fdc4819a460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c970 tx=0x7fdc3800ce30 comp rx=0 tx=0).stop 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 shutdown_connections 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fdc300b65d0 0x7fdc300b8ae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc4810de90 0x7fdc4819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc48105380 0x7fdc4819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 --2- 172.21.15.29:0/2497469497 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdc48104a30 0x7fdc4819a460 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 >> 172.21.15.29:0/2497469497 conn(0x7fdc48079770 msgr2=0x7fdc48100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 shutdown_connections 2024-09-21T07:08:05.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:05.541+0000 7fdc4dddf640 1 -- 172.21.15.29:0/2497469497 wait complete. 2024-09-21T07:08:05.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:05 smithi052 ceph-mon[34308]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 2 B/s, 1 objects/s recovering 2024-09-21T07:08:06.007 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:05 smithi029 ceph-mon[30983]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 2 B/s, 1 objects/s recovering 2024-09-21T07:08:06.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:05 smithi066 ceph-mon[34793]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s; 2 B/s, 1 objects/s recovering 2024-09-21T07:08:06.451 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-21T07:08:03.999313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660966,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":279,"num_read_kb":231,"num_write":369,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386052,"kb_used_data":11776,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555772,"statfs":{"total":1151940427776,"available":1151545110528,"internally_reserved":0,"allocated":12058624,"data_stored":6699756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8514,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":42,"num_write":11,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002282"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665830+0000","last_change":"2024-09-21T07:07:32.566786+0000","last_active":"2024-09-21T07:07:57.665830+0000","last_peered":"2024-09-21T07:07:57.665830+0000","last_clean":"2024-09-21T07:07:57.665830+0000","last_became_active":"2024-09-21T07:07:32.565722+0000","last_became_peered":"2024-09-21T07:07:32.565722+0000","last_unstale":"2024-09-21T07:07:57.665830+0000","last_undegraded":"2024-09-21T07:07:57.665830+0000","last_fullsized":"2024-09-21T07:07:57.665830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:22.389773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700880+0000","last_change":"2024-09-21T07:07:32.556460+0000","last_active":"2024-09-21T07:07:57.700880+0000","last_peered":"2024-09-21T07:07:57.700880+0000","last_clean":"2024-09-21T07:07:57.700880+0000","last_became_active":"2024-09-21T07:07:32.555738+0000","last_became_peered":"2024-09-21T07:07:32.555738+0000","last_unstale":"2024-09-21T07:07:57.700880+0000","last_undegraded":"2024-09-21T07:07:57.700880+0000","last_fullsized":"2024-09-21T07:07:57.700880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.921413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700779+0000","last_change":"2024-09-21T07:07:32.565814+0000","last_active":"2024-09-21T07:07:57.700779+0000","last_peered":"2024-09-21T07:07:57.700779+0000","last_clean":"2024-09-21T07:07:57.700779+0000","last_became_active":"2024-09-21T07:07:32.565401+0000","last_became_peered":"2024-09-21T07:07:32.565401+0000","last_unstale":"2024-09-21T07:07:57.700779+0000","last_undegraded":"2024-09-21T07:07:57.700779+0000","last_fullsized":"2024-09-21T07:07:57.700779+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:56.705903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668559+0000","last_change":"2024-09-21T07:07:32.554713+0000","last_active":"2024-09-21T07:07:57.668559+0000","last_peered":"2024-09-21T07:07:57.668559+0000","last_clean":"2024-09-21T07:07:57.668559+0000","last_became_active":"2024-09-21T07:07:32.554203+0000","last_became_peered":"2024-09-21T07:07:32.554203+0000","last_unstale":"2024-09-21T07:07:57.668559+0000","last_undegraded":"2024-09-21T07:07:57.668559+0000","last_fullsized":"2024-09-21T07:07:57.668559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:29.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665134+0000","last_change":"2024-09-21T07:07:32.566048+0000","last_active":"2024-09-21T07:07:57.665134+0000","last_peered":"2024-09-21T07:07:57.665134+0000","last_clean":"2024-09-21T07:07:57.665134+0000","last_became_active":"2024-09-21T07:07:32.565659+0000","last_became_peered":"2024-09-21T07:07:32.565659+0000","last_unstale":"2024-09-21T07:07:57.665134+0000","last_undegraded":"2024-09-21T07:07:57.665134+0000","last_fullsized":"2024-09-21T07:07:57.665134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:56.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662196+0000","last_change":"2024-09-21T07:07:32.550492+0000","last_active":"2024-09-21T07:07:57.662196+0000","last_peered":"2024-09-21T07:07:57.662196+0000","last_clean":"2024-09-21T07:07:57.662196+0000","last_became_active":"2024-09-21T07:07:32.549691+0000","last_became_peered":"2024-09-21T07:07:32.549691+0000","last_unstale":"2024-09-21T07:07:57.662196+0000","last_undegraded":"2024-09-21T07:07:57.662196+0000","last_fullsized":"2024-09-21T07:07:57.662196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.890164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665985+0000","last_change":"2024-09-21T07:07:32.560258+0000","last_active":"2024-09-21T07:07:57.665985+0000","last_peered":"2024-09-21T07:07:57.665985+0000","last_clean":"2024-09-21T07:07:57.665985+0000","last_became_active":"2024-09-21T07:07:32.559890+0000","last_became_peered":"2024-09-21T07:07:32.559890+0000","last_unstale":"2024-09-21T07:07:57.665985+0000","last_undegraded":"2024-09-21T07:07:57.665985+0000","last_fullsized":"2024-09-21T07:07:57.665985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.794736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667805+0000","last_change":"2024-09-21T07:07:32.560923+0000","last_active":"2024-09-21T07:07:57.667805+0000","last_peered":"2024-09-21T07:07:57.667805+0000","last_clean":"2024-09-21T07:07:57.667805+0000","last_became_active":"2024-09-21T07:07:32.560509+0000","last_became_peered":"2024-09-21T07:07:32.560509+0000","last_unstale":"2024-09-21T07:07:57.667805+0000","last_undegraded":"2024-09-21T07:07:57.667805+0000","last_fullsized":"2024-09-21T07:07:57.667805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:59.576434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670812+0000","last_change":"2024-09-21T07:07:32.564475+0000","last_active":"2024-09-21T07:07:57.670812+0000","last_peered":"2024-09-21T07:07:57.670812+0000","last_clean":"2024-09-21T07:07:57.670812+0000","last_became_active":"2024-09-21T07:07:32.564115+0000","last_became_peered":"2024-09-21T07:07:32.564115+0000","last_unstale":"2024-09-21T07:07:57.670812+0000","last_undegraded":"2024-09-21T07:07:57.670812+0000","last_fullsized":"2024-09-21T07:07:57.670812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:03.989109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662889+0000","last_change":"2024-09-21T07:07:32.557377+0000","last_active":"2024-09-21T07:07:57.662889+0000","last_peered":"2024-09-21T07:07:57.662889+0000","last_clean":"2024-09-21T07:07:57.662889+0000","last_became_active":"2024-09-21T07:07:32.556732+0000","last_became_peered":"2024-09-21T07:07:32.556732+0000","last_unstale":"2024-09-21T07:07:57.662889+0000","last_undegraded":"2024-09-21T07:07:57.662889+0000","last_fullsized":"2024-09-21T07:07:57.662889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:32.474690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666465+0000","last_change":"2024-09-21T07:07:32.558691+0000","last_active":"2024-09-21T07:07:57.666465+0000","last_peered":"2024-09-21T07:07:57.666465+0000","last_clean":"2024-09-21T07:07:57.666465+0000","last_became_active":"2024-09-21T07:07:32.558029+0000","last_became_peered":"2024-09-21T07:07:32.558029+0000","last_unstale":"2024-09-21T07:07:57.666465+0000","last_undegraded":"2024-09-21T07:07:57.666465+0000","last_fullsized":"2024-09-21T07:07:57.666465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.378786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668606+0000","last_change":"2024-09-21T07:07:32.556500+0000","last_active":"2024-09-21T07:07:57.668606+0000","last_peered":"2024-09-21T07:07:57.668606+0000","last_clean":"2024-09-21T07:07:57.668606+0000","last_became_active":"2024-09-21T07:07:32.555529+0000","last_became_peered":"2024-09-21T07:07:32.555529+0000","last_unstale":"2024-09-21T07:07:57.668606+0000","last_undegraded":"2024-09-21T07:07:57.668606+0000","last_fullsized":"2024-09-21T07:07:57.668606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.494498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664151+0000","last_change":"2024-09-21T07:07:32.560235+0000","last_active":"2024-09-21T07:07:57.664151+0000","last_peered":"2024-09-21T07:07:57.664151+0000","last_clean":"2024-09-21T07:07:57.664151+0000","last_became_active":"2024-09-21T07:07:32.559834+0000","last_became_peered":"2024-09-21T07:07:32.559834+0000","last_unstale":"2024-09-21T07:07:57.664151+0000","last_undegraded":"2024-09-21T07:07:57.664151+0000","last_fullsized":"2024-09-21T07:07:57.664151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:30.090878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700558+0000","last_change":"2024-09-21T07:07:32.554158+0000","last_active":"2024-09-21T07:07:57.700558+0000","last_peered":"2024-09-21T07:07:57.700558+0000","last_clean":"2024-09-21T07:07:57.700558+0000","last_became_active":"2024-09-21T07:07:32.553837+0000","last_became_peered":"2024-09-21T07:07:32.553837+0000","last_unstale":"2024-09-21T07:07:57.700558+0000","last_undegraded":"2024-09-21T07:07:57.700558+0000","last_fullsized":"2024-09-21T07:07:57.700558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:23.845629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700519+0000","last_change":"2024-09-21T07:07:32.556921+0000","last_active":"2024-09-21T07:07:57.700519+0000","last_peered":"2024-09-21T07:07:57.700519+0000","last_clean":"2024-09-21T07:07:57.700519+0000","last_became_active":"2024-09-21T07:07:32.556529+0000","last_became_peered":"2024-09-21T07:07:32.556529+0000","last_unstale":"2024-09-21T07:07:57.700519+0000","last_undegraded":"2024-09-21T07:07:57.700519+0000","last_fullsized":"2024-09-21T07:07:57.700519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.447617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669857+0000","last_change":"2024-09-21T07:07:32.567572+0000","last_active":"2024-09-21T07:07:57.669857+0000","last_peered":"2024-09-21T07:07:57.669857+0000","last_clean":"2024-09-21T07:07:57.669857+0000","last_became_active":"2024-09-21T07:07:32.567159+0000","last_became_peered":"2024-09-21T07:07:32.567159+0000","last_unstale":"2024-09-21T07:07:57.669857+0000","last_undegraded":"2024-09-21T07:07:57.669857+0000","last_fullsized":"2024-09-21T07:07:57.669857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.316539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665990+0000","last_change":"2024-09-21T07:07:32.567213+0000","last_active":"2024-09-21T07:07:57.665990+0000","last_peered":"2024-09-21T07:07:57.665990+0000","last_clean":"2024-09-21T07:07:57.665990+0000","last_became_active":"2024-09-21T07:07:32.566284+0000","last_became_peered":"2024-09-21T07:07:32.566284+0000","last_unstale":"2024-09-21T07:07:57.665990+0000","last_undegraded":"2024-09-21T07:07:57.665990+0000","last_fullsized":"2024-09-21T07:07:57.665990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661267+0000","last_change":"2024-09-21T07:07:32.551695+0000","last_active":"2024-09-21T07:07:57.661267+0000","last_peered":"2024-09-21T07:07:57.661267+0000","last_clean":"2024-09-21T07:07:57.661267+0000","last_became_active":"2024-09-21T07:07:32.551282+0000","last_became_peered":"2024-09-21T07:07:32.551282+0000","last_unstale":"2024-09-21T07:07:57.661267+0000","last_undegraded":"2024-09-21T07:07:57.661267+0000","last_fullsized":"2024-09-21T07:07:57.661267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:33.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669799+0000","last_change":"2024-09-21T07:07:32.551000+0000","last_active":"2024-09-21T07:07:57.669799+0000","last_peered":"2024-09-21T07:07:57.669799+0000","last_clean":"2024-09-21T07:07:57.669799+0000","last_became_active":"2024-09-21T07:07:32.550590+0000","last_became_peered":"2024-09-21T07:07:32.550590+0000","last_unstale":"2024-09-21T07:07:57.669799+0000","last_undegraded":"2024-09-21T07:07:57.669799+0000","last_fullsized":"2024-09-21T07:07:57.669799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:30.213470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668399+0000","last_change":"2024-09-21T07:07:57.668284+0000","last_active":"2024-09-21T07:07:57.668399+0000","last_peered":"2024-09-21T07:07:57.668399+0000","last_clean":"2024-09-21T07:07:57.668399+0000","last_became_active":"2024-09-21T07:07:57.667145+0000","last_became_peered":"2024-09-21T07:07:57.667145+0000","last_unstale":"2024-09-21T07:07:57.668399+0000","last_undegraded":"2024-09-21T07:07:57.668399+0000","last_fullsized":"2024-09-21T07:07:57.668399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:11.662321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664164+0000","last_change":"2024-09-21T07:07:32.555752+0000","last_active":"2024-09-21T07:07:57.664164+0000","last_peered":"2024-09-21T07:07:57.664164+0000","last_clean":"2024-09-21T07:07:57.664164+0000","last_became_active":"2024-09-21T07:07:32.555057+0000","last_became_peered":"2024-09-21T07:07:32.555057+0000","last_unstale":"2024-09-21T07:07:57.664164+0000","last_undegraded":"2024-09-21T07:07:57.664164+0000","last_fullsized":"2024-09-21T07:07:57.664164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:03.161990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670600+0000","last_change":"2024-09-21T07:07:32.555589+0000","last_active":"2024-09-21T07:07:57.670600+0000","last_peered":"2024-09-21T07:07:57.670600+0000","last_clean":"2024-09-21T07:07:57.670600+0000","last_became_active":"2024-09-21T07:07:32.555037+0000","last_became_peered":"2024-09-21T07:07:32.555037+0000","last_unstale":"2024-09-21T07:07:57.670600+0000","last_undegraded":"2024-09-21T07:07:57.670600+0000","last_fullsized":"2024-09-21T07:07:57.670600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:25.346546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667780+0000","last_change":"2024-09-21T07:07:32.559407+0000","last_active":"2024-09-21T07:07:57.667780+0000","last_peered":"2024-09-21T07:07:57.667780+0000","last_clean":"2024-09-21T07:07:57.667780+0000","last_became_active":"2024-09-21T07:07:32.559112+0000","last_became_peered":"2024-09-21T07:07:32.559112+0000","last_unstale":"2024-09-21T07:07:57.667780+0000","last_undegraded":"2024-09-21T07:07:57.667780+0000","last_fullsized":"2024-09-21T07:07:57.667780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:13.970511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669197+0000","last_change":"2024-09-21T07:07:32.564798+0000","last_active":"2024-09-21T07:07:57.669197+0000","last_peered":"2024-09-21T07:07:57.669197+0000","last_clean":"2024-09-21T07:07:57.669197+0000","last_became_active":"2024-09-21T07:07:32.564381+0000","last_became_peered":"2024-09-21T07:07:32.564381+0000","last_unstale":"2024-09-21T07:07:57.669197+0000","last_undegraded":"2024-09-21T07:07:57.669197+0000","last_fullsized":"2024-09-21T07:07:57.669197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:19.667252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668233+0000","last_change":"2024-09-21T07:07:32.555274+0000","last_active":"2024-09-21T07:07:57.668233+0000","last_peered":"2024-09-21T07:07:57.668233+0000","last_clean":"2024-09-21T07:07:57.668233+0000","last_became_active":"2024-09-21T07:07:32.554816+0000","last_became_peered":"2024-09-21T07:07:32.554816+0000","last_unstale":"2024-09-21T07:07:57.668233+0000","last_undegraded":"2024-09-21T07:07:57.668233+0000","last_fullsized":"2024-09-21T07:07:57.668233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.018974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.671064+0000","last_change":"2024-09-21T07:07:32.555655+0000","last_active":"2024-09-21T07:07:57.671064+0000","last_peered":"2024-09-21T07:07:57.671064+0000","last_clean":"2024-09-21T07:07:57.671064+0000","last_became_active":"2024-09-21T07:07:32.555240+0000","last_became_peered":"2024-09-21T07:07:32.555240+0000","last_unstale":"2024-09-21T07:07:57.671064+0000","last_undegraded":"2024-09-21T07:07:57.671064+0000","last_fullsized":"2024-09-21T07:07:57.671064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:51.550091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664496+0000","last_change":"2024-09-21T07:07:32.570761+0000","last_active":"2024-09-21T07:07:57.664496+0000","last_peered":"2024-09-21T07:07:57.664496+0000","last_clean":"2024-09-21T07:07:57.664496+0000","last_became_active":"2024-09-21T07:07:32.569555+0000","last_became_peered":"2024-09-21T07:07:32.569555+0000","last_unstale":"2024-09-21T07:07:57.664496+0000","last_undegraded":"2024-09-21T07:07:57.664496+0000","last_fullsized":"2024-09-21T07:07:57.664496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:23.414096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.702052+0000","last_change":"2024-09-21T07:07:57.701944+0000","last_active":"2024-09-21T07:07:57.702052+0000","last_peered":"2024-09-21T07:07:57.702052+0000","last_clean":"2024-09-21T07:07:57.702052+0000","last_became_active":"2024-09-21T07:07:57.701461+0000","last_became_peered":"2024-09-21T07:07:57.701461+0000","last_unstale":"2024-09-21T07:07:57.702052+0000","last_undegraded":"2024-09-21T07:07:57.702052+0000","last_fullsized":"2024-09-21T07:07:57.702052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:36.219766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700760+0000","last_change":"2024-09-21T07:07:32.550889+0000","last_active":"2024-09-21T07:07:57.700760+0000","last_peered":"2024-09-21T07:07:57.700760+0000","last_clean":"2024-09-21T07:07:57.700760+0000","last_became_active":"2024-09-21T07:07:32.550559+0000","last_became_peered":"2024-09-21T07:07:32.550559+0000","last_unstale":"2024-09-21T07:07:57.700760+0000","last_undegraded":"2024-09-21T07:07:57.700760+0000","last_fullsized":"2024-09-21T07:07:57.700760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:35.575626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669528+0000","last_change":"2024-09-21T07:07:32.552019+0000","last_active":"2024-09-21T07:07:57.669528+0000","last_peered":"2024-09-21T07:07:57.669528+0000","last_clean":"2024-09-21T07:07:57.669528+0000","last_became_active":"2024-09-21T07:07:32.551562+0000","last_became_peered":"2024-09-21T07:07:32.551562+0000","last_unstale":"2024-09-21T07:07:57.669528+0000","last_undegraded":"2024-09-21T07:07:57.669528+0000","last_fullsized":"2024-09-21T07:07:57.669528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:25.932560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669832+0000","last_change":"2024-09-21T07:07:32.556938+0000","last_active":"2024-09-21T07:07:57.669832+0000","last_peered":"2024-09-21T07:07:57.669832+0000","last_clean":"2024-09-21T07:07:57.669832+0000","last_became_active":"2024-09-21T07:07:32.556331+0000","last_became_peered":"2024-09-21T07:07:32.556331+0000","last_unstale":"2024-09-21T07:07:57.669832+0000","last_undegraded":"2024-09-21T07:07:57.669832+0000","last_fullsized":"2024-09-21T07:07:57.669832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.358076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664137+0000","last_change":"2024-09-21T07:07:32.561984+0000","last_active":"2024-09-21T07:07:57.664137+0000","last_peered":"2024-09-21T07:07:57.664137+0000","last_clean":"2024-09-21T07:07:57.664137+0000","last_became_active":"2024-09-21T07:07:32.561227+0000","last_became_peered":"2024-09-21T07:07:32.561227+0000","last_unstale":"2024-09-21T07:07:57.664137+0000","last_undegraded":"2024-09-21T07:07:57.664137+0000","last_fullsized":"2024-09-21T07:07:57.664137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:35.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666875+0000","last_change":"2024-09-21T07:07:32.567454+0000","last_active":"2024-09-21T07:07:57.666875+0000","last_peered":"2024-09-21T07:07:57.666875+0000","last_clean":"2024-09-21T07:07:57.666875+0000","last_became_active":"2024-09-21T07:07:32.567063+0000","last_became_peered":"2024-09-21T07:07:32.567063+0000","last_unstale":"2024-09-21T07:07:57.666875+0000","last_undegraded":"2024-09-21T07:07:57.666875+0000","last_fullsized":"2024-09-21T07:07:57.666875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.466771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:59.660313+0000","last_change":"2024-09-21T07:07:30.548785+0000","last_active":"2024-09-21T07:07:59.660313+0000","last_peered":"2024-09-21T07:07:59.660313+0000","last_clean":"2024-09-21T07:07:59.660313+0000","last_became_active":"2024-09-21T07:07:30.547764+0000","last_became_peered":"2024-09-21T07:07:30.547764+0000","last_unstale":"2024-09-21T07:07:59.660313+0000","last_undegraded":"2024-09-21T07:07:59.660313+0000","last_fullsized":"2024-09-21T07:07:59.660313+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:18.115002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669774+0000","last_change":"2024-09-21T07:07:57.669607+0000","last_active":"2024-09-21T07:07:57.669774+0000","last_peered":"2024-09-21T07:07:57.669774+0000","last_clean":"2024-09-21T07:07:57.669774+0000","last_became_active":"2024-09-21T07:07:57.669149+0000","last_became_peered":"2024-09-21T07:07:57.669149+0000","last_unstale":"2024-09-21T07:07:57.669774+0000","last_undegraded":"2024-09-21T07:07:57.669774+0000","last_fullsized":"2024-09-21T07:07:57.669774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:20.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.686559+0000","last_change":"2024-09-21T07:07:57.686466+0000","last_active":"2024-09-21T07:07:57.686559+0000","last_peered":"2024-09-21T07:07:57.686559+0000","last_clean":"2024-09-21T07:07:57.686559+0000","last_became_active":"2024-09-21T07:07:57.671977+0000","last_became_peered":"2024-09-21T07:07:57.671977+0000","last_unstale":"2024-09-21T07:07:57.686559+0000","last_undegraded":"2024-09-21T07:07:57.686559+0000","last_fullsized":"2024-09-21T07:07:57.686559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:26.134854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663868+0000","last_change":"2024-09-21T07:07:30.539941+0000","last_active":"2024-09-21T07:07:57.663868+0000","last_peered":"2024-09-21T07:07:57.663868+0000","last_clean":"2024-09-21T07:07:57.663868+0000","last_became_active":"2024-09-21T07:07:30.539401+0000","last_became_peered":"2024-09-21T07:07:30.539401+0000","last_unstale":"2024-09-21T07:07:57.663868+0000","last_undegraded":"2024-09-21T07:07:57.663868+0000","last_fullsized":"2024-09-21T07:07:57.663868+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:15.184453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667870+0000","last_change":"2024-09-21T07:07:32.556958+0000","last_active":"2024-09-21T07:07:57.667870+0000","last_peered":"2024-09-21T07:07:57.667870+0000","last_clean":"2024-09-21T07:07:57.667870+0000","last_became_active":"2024-09-21T07:07:32.556581+0000","last_became_peered":"2024-09-21T07:07:32.556581+0000","last_unstale":"2024-09-21T07:07:57.667870+0000","last_undegraded":"2024-09-21T07:07:57.667870+0000","last_fullsized":"2024-09-21T07:07:57.667870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:57.618263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668760+0000","last_change":"2024-09-21T07:07:30.547760+0000","last_active":"2024-09-21T07:07:57.668760+0000","last_peered":"2024-09-21T07:07:57.668760+0000","last_clean":"2024-09-21T07:07:57.668760+0000","last_became_active":"2024-09-21T07:07:30.547327+0000","last_became_peered":"2024-09-21T07:07:30.547327+0000","last_unstale":"2024-09-21T07:07:57.668760+0000","last_undegraded":"2024-09-21T07:07:57.668760+0000","last_fullsized":"2024-09-21T07:07:57.668760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:01.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.660833+0000","last_change":"2024-09-21T07:07:32.552691+0000","last_active":"2024-09-21T07:07:57.660833+0000","last_peered":"2024-09-21T07:07:57.660833+0000","last_clean":"2024-09-21T07:07:57.660833+0000","last_became_active":"2024-09-21T07:07:32.552321+0000","last_became_peered":"2024-09-21T07:07:32.552321+0000","last_unstale":"2024-09-21T07:07:57.660833+0000","last_undegraded":"2024-09-21T07:07:57.660833+0000","last_fullsized":"2024-09-21T07:07:57.660833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:56.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":57,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:58.658342+0000","last_change":"2024-09-21T07:07:30.545281+0000","last_active":"2024-09-21T07:07:58.658342+0000","last_peered":"2024-09-21T07:07:58.658342+0000","last_clean":"2024-09-21T07:07:58.658342+0000","last_became_active":"2024-09-21T07:07:30.544823+0000","last_became_peered":"2024-09-21T07:07:30.544823+0000","last_unstale":"2024-09-21T07:07:58.658342+0000","last_undegraded":"2024-09-21T07:07:58.658342+0000","last_fullsized":"2024-09-21T07:07:58.658342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.659421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670838+0000","last_change":"2024-09-21T07:07:32.567833+0000","last_active":"2024-09-21T07:07:57.670838+0000","last_peered":"2024-09-21T07:07:57.670838+0000","last_clean":"2024-09-21T07:07:57.670838+0000","last_became_active":"2024-09-21T07:07:32.566902+0000","last_became_peered":"2024-09-21T07:07:32.566902+0000","last_unstale":"2024-09-21T07:07:57.670838+0000","last_undegraded":"2024-09-21T07:07:57.670838+0000","last_fullsized":"2024-09-21T07:07:57.670838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.871038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.681468+0000","last_change":"2024-09-21T07:07:57.681319+0000","last_active":"2024-09-21T07:07:57.681468+0000","last_peered":"2024-09-21T07:07:57.681468+0000","last_clean":"2024-09-21T07:07:57.681468+0000","last_became_active":"2024-09-21T07:07:57.671744+0000","last_became_peered":"2024-09-21T07:07:57.671744+0000","last_unstale":"2024-09-21T07:07:57.681468+0000","last_undegraded":"2024-09-21T07:07:57.681468+0000","last_fullsized":"2024-09-21T07:07:57.681468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:51.145118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701091+0000","last_change":"2024-09-21T07:07:32.561445+0000","last_active":"2024-09-21T07:07:57.701091+0000","last_peered":"2024-09-21T07:07:57.701091+0000","last_clean":"2024-09-21T07:07:57.701091+0000","last_became_active":"2024-09-21T07:07:32.561033+0000","last_became_peered":"2024-09-21T07:07:32.561033+0000","last_unstale":"2024-09-21T07:07:57.701091+0000","last_undegraded":"2024-09-21T07:07:57.701091+0000","last_fullsized":"2024-09-21T07:07:57.701091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:30.261234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668524+0000","last_change":"2024-09-21T07:07:30.755110+0000","last_active":"2024-09-21T07:07:57.668524+0000","last_peered":"2024-09-21T07:07:57.668524+0000","last_clean":"2024-09-21T07:07:57.668524+0000","last_became_active":"2024-09-21T07:07:30.754680+0000","last_became_peered":"2024-09-21T07:07:30.754680+0000","last_unstale":"2024-09-21T07:07:57.668524+0000","last_undegraded":"2024-09-21T07:07:57.668524+0000","last_fullsized":"2024-09-21T07:07:57.668524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.202010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670386+0000","last_change":"2024-09-21T07:07:32.557349+0000","last_active":"2024-09-21T07:07:57.670386+0000","last_peered":"2024-09-21T07:07:57.670386+0000","last_clean":"2024-09-21T07:07:57.670386+0000","last_became_active":"2024-09-21T07:07:32.554342+0000","last_became_peered":"2024-09-21T07:07:32.554342+0000","last_unstale":"2024-09-21T07:07:57.670386+0000","last_undegraded":"2024-09-21T07:07:57.670386+0000","last_fullsized":"2024-09-21T07:07:57.670386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:21.356410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:58.661721+0000","last_change":"2024-09-21T07:07:30.547691+0000","last_active":"2024-09-21T07:07:58.661721+0000","last_peered":"2024-09-21T07:07:58.661721+0000","last_clean":"2024-09-21T07:07:58.661721+0000","last_became_active":"2024-09-21T07:07:30.547280+0000","last_became_peered":"2024-09-21T07:07:30.547280+0000","last_unstale":"2024-09-21T07:07:58.661721+0000","last_undegraded":"2024-09-21T07:07:58.661721+0000","last_fullsized":"2024-09-21T07:07:58.661721+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:24.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62769,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":70,"num_write":30,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665578+0000","last_change":"2024-09-21T07:07:32.569291+0000","last_active":"2024-09-21T07:07:57.665578+0000","last_peered":"2024-09-21T07:07:57.665578+0000","last_clean":"2024-09-21T07:07:57.665578+0000","last_became_active":"2024-09-21T07:07:32.568503+0000","last_became_peered":"2024-09-21T07:07:32.568503+0000","last_unstale":"2024-09-21T07:07:57.665578+0000","last_undegraded":"2024-09-21T07:07:57.665578+0000","last_fullsized":"2024-09-21T07:07:57.665578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:56.184795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669620+0000","last_change":"2024-09-21T07:07:30.546624+0000","last_active":"2024-09-21T07:07:57.669620+0000","last_peered":"2024-09-21T07:07:57.669620+0000","last_clean":"2024-09-21T07:07:57.669620+0000","last_became_active":"2024-09-21T07:07:30.545497+0000","last_became_peered":"2024-09-21T07:07:30.545497+0000","last_unstale":"2024-09-21T07:07:57.669620+0000","last_undegraded":"2024-09-21T07:07:57.669620+0000","last_fullsized":"2024-09-21T07:07:57.669620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.963089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663965+0000","last_change":"2024-09-21T07:07:32.551123+0000","last_active":"2024-09-21T07:07:57.663965+0000","last_peered":"2024-09-21T07:07:57.663965+0000","last_clean":"2024-09-21T07:07:57.663965+0000","last_became_active":"2024-09-21T07:07:32.550423+0000","last_became_peered":"2024-09-21T07:07:32.550423+0000","last_unstale":"2024-09-21T07:07:57.663965+0000","last_undegraded":"2024-09-21T07:07:57.663965+0000","last_fullsized":"2024-09-21T07:07:57.663965+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:00.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668428+0000","last_change":"2024-09-21T07:07:30.550102+0000","last_active":"2024-09-21T07:07:57.668428+0000","last_peered":"2024-09-21T07:07:57.668428+0000","last_clean":"2024-09-21T07:07:57.668428+0000","last_became_active":"2024-09-21T07:07:30.549609+0000","last_became_peered":"2024-09-21T07:07:30.549609+0000","last_unstale":"2024-09-21T07:07:57.668428+0000","last_undegraded":"2024-09-21T07:07:57.668428+0000","last_fullsized":"2024-09-21T07:07:57.668428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:58.587612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666452+0000","last_change":"2024-09-21T07:07:32.556167+0000","last_active":"2024-09-21T07:07:57.666452+0000","last_peered":"2024-09-21T07:07:57.666452+0000","last_clean":"2024-09-21T07:07:57.666452+0000","last_became_active":"2024-09-21T07:07:32.555372+0000","last_became_peered":"2024-09-21T07:07:32.555372+0000","last_unstale":"2024-09-21T07:07:57.666452+0000","last_undegraded":"2024-09-21T07:07:57.666452+0000","last_fullsized":"2024-09-21T07:07:57.666452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:35.056919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:58.659519+0000","last_change":"2024-09-21T07:07:30.543196+0000","last_active":"2024-09-21T07:07:58.659519+0000","last_peered":"2024-09-21T07:07:58.659519+0000","last_clean":"2024-09-21T07:07:58.659519+0000","last_became_active":"2024-09-21T07:07:30.542755+0000","last_became_peered":"2024-09-21T07:07:30.542755+0000","last_unstale":"2024-09-21T07:07:58.659519+0000","last_undegraded":"2024-09-21T07:07:58.659519+0000","last_fullsized":"2024-09-21T07:07:58.659519+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:14.821703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665906+0000","last_change":"2024-09-21T07:07:32.561243+0000","last_active":"2024-09-21T07:07:57.665906+0000","last_peered":"2024-09-21T07:07:57.665906+0000","last_clean":"2024-09-21T07:07:57.665906+0000","last_became_active":"2024-09-21T07:07:32.560878+0000","last_became_peered":"2024-09-21T07:07:32.560878+0000","last_unstale":"2024-09-21T07:07:57.665906+0000","last_undegraded":"2024-09-21T07:07:57.665906+0000","last_fullsized":"2024-09-21T07:07:57.665906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:19.342422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664720+0000","last_change":"2024-09-21T07:07:30.754985+0000","last_active":"2024-09-21T07:07:57.664720+0000","last_peered":"2024-09-21T07:07:57.664720+0000","last_clean":"2024-09-21T07:07:57.664720+0000","last_became_active":"2024-09-21T07:07:30.754490+0000","last_became_peered":"2024-09-21T07:07:30.754490+0000","last_unstale":"2024-09-21T07:07:57.664720+0000","last_undegraded":"2024-09-21T07:07:57.664720+0000","last_fullsized":"2024-09-21T07:07:57.664720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:21.645643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667978+0000","last_change":"2024-09-21T07:07:32.567997+0000","last_active":"2024-09-21T07:07:57.667978+0000","last_peered":"2024-09-21T07:07:57.667978+0000","last_clean":"2024-09-21T07:07:57.667978+0000","last_became_active":"2024-09-21T07:07:32.567314+0000","last_became_peered":"2024-09-21T07:07:32.567314+0000","last_unstale":"2024-09-21T07:07:57.667978+0000","last_undegraded":"2024-09-21T07:07:57.667978+0000","last_fullsized":"2024-09-21T07:07:57.667978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:07.741967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.678889+0000","last_change":"2024-09-21T07:07:57.678175+0000","last_active":"2024-09-21T07:07:57.678889+0000","last_peered":"2024-09-21T07:07:57.678889+0000","last_clean":"2024-09-21T07:07:57.678889+0000","last_became_active":"2024-09-21T07:07:57.671137+0000","last_became_peered":"2024-09-21T07:07:57.671137+0000","last_unstale":"2024-09-21T07:07:57.678889+0000","last_undegraded":"2024-09-21T07:07:57.678889+0000","last_fullsized":"2024-09-21T07:07:57.678889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664423+0000","last_change":"2024-09-21T07:07:32.563380+0000","last_active":"2024-09-21T07:07:57.664423+0000","last_peered":"2024-09-21T07:07:57.664423+0000","last_clean":"2024-09-21T07:07:57.664423+0000","last_became_active":"2024-09-21T07:07:32.563012+0000","last_became_peered":"2024-09-21T07:07:32.563012+0000","last_unstale":"2024-09-21T07:07:57.664423+0000","last_undegraded":"2024-09-21T07:07:57.664423+0000","last_fullsized":"2024-09-21T07:07:57.664423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664634+0000","last_change":"2024-09-21T07:07:30.546448+0000","last_active":"2024-09-21T07:07:57.664634+0000","last_peered":"2024-09-21T07:07:57.664634+0000","last_clean":"2024-09-21T07:07:57.664634+0000","last_became_active":"2024-09-21T07:07:30.546015+0000","last_became_peered":"2024-09-21T07:07:30.546015+0000","last_unstale":"2024-09-21T07:07:57.664634+0000","last_undegraded":"2024-09-21T07:07:57.664634+0000","last_fullsized":"2024-09-21T07:07:57.664634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:23.041651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666630+0000","last_change":"2024-09-21T07:07:32.562533+0000","last_active":"2024-09-21T07:07:57.666630+0000","last_peered":"2024-09-21T07:07:57.666630+0000","last_clean":"2024-09-21T07:07:57.666630+0000","last_became_active":"2024-09-21T07:07:32.562101+0000","last_became_peered":"2024-09-21T07:07:32.562101+0000","last_unstale":"2024-09-21T07:07:57.666630+0000","last_undegraded":"2024-09-21T07:07:57.666630+0000","last_fullsized":"2024-09-21T07:07:57.666630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:49.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668720+0000","last_change":"2024-09-21T07:07:30.547263+0000","last_active":"2024-09-21T07:07:57.668720+0000","last_peered":"2024-09-21T07:07:57.668720+0000","last_clean":"2024-09-21T07:07:57.668720+0000","last_became_active":"2024-09-21T07:07:30.546874+0000","last_became_peered":"2024-09-21T07:07:30.546874+0000","last_unstale":"2024-09-21T07:07:57.668720+0000","last_undegraded":"2024-09-21T07:07:57.668720+0000","last_fullsized":"2024-09-21T07:07:57.668720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:18.545407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666337+0000","last_change":"2024-09-21T07:07:32.560288+0000","last_active":"2024-09-21T07:07:57.666337+0000","last_peered":"2024-09-21T07:07:57.666337+0000","last_clean":"2024-09-21T07:07:57.666337+0000","last_became_active":"2024-09-21T07:07:32.559938+0000","last_became_peered":"2024-09-21T07:07:32.559938+0000","last_unstale":"2024-09-21T07:07:57.666337+0000","last_undegraded":"2024-09-21T07:07:57.666337+0000","last_fullsized":"2024-09-21T07:07:57.666337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:55.531828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:01.662886+0000","last_change":"2024-09-21T07:07:30.754602+0000","last_active":"2024-09-21T07:08:01.662886+0000","last_peered":"2024-09-21T07:08:01.662886+0000","last_clean":"2024-09-21T07:08:01.662886+0000","last_became_active":"2024-09-21T07:07:30.754159+0000","last_became_peered":"2024-09-21T07:07:30.754159+0000","last_unstale":"2024-09-21T07:08:01.662886+0000","last_undegraded":"2024-09-21T07:08:01.662886+0000","last_fullsized":"2024-09-21T07:08:01.662886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666629+0000","last_change":"2024-09-21T07:07:32.557819+0000","last_active":"2024-09-21T07:07:57.666629+0000","last_peered":"2024-09-21T07:07:57.666629+0000","last_clean":"2024-09-21T07:07:57.666629+0000","last_became_active":"2024-09-21T07:07:32.557363+0000","last_became_peered":"2024-09-21T07:07:32.557363+0000","last_unstale":"2024-09-21T07:07:57.666629+0000","last_undegraded":"2024-09-21T07:07:57.666629+0000","last_fullsized":"2024-09-21T07:07:57.666629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.802658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666087+0000","last_change":"2024-09-21T07:06:20.138629+0000","last_active":"2024-09-21T07:07:57.666087+0000","last_peered":"2024-09-21T07:07:57.666087+0000","last_clean":"2024-09-21T07:07:57.666087+0000","last_became_active":"2024-09-21T07:06:20.132041+0000","last_became_peered":"2024-09-21T07:06:20.132041+0000","last_unstale":"2024-09-21T07:07:57.666087+0000","last_undegraded":"2024-09-21T07:07:57.666087+0000","last_fullsized":"2024-09-21T07:07:57.666087+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_clean_scrub_stamp":"2024-09-21T07:02:52.790893+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:41.784916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668277+0000","last_change":"2024-09-21T07:07:30.541638+0000","last_active":"2024-09-21T07:07:57.668277+0000","last_peered":"2024-09-21T07:07:57.668277+0000","last_clean":"2024-09-21T07:07:57.668277+0000","last_became_active":"2024-09-21T07:07:30.541185+0000","last_became_peered":"2024-09-21T07:07:30.541185+0000","last_unstale":"2024-09-21T07:07:57.668277+0000","last_undegraded":"2024-09-21T07:07:57.668277+0000","last_fullsized":"2024-09-21T07:07:57.668277+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:15.837077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668365+0000","last_change":"2024-09-21T07:07:32.560817+0000","last_active":"2024-09-21T07:07:57.668365+0000","last_peered":"2024-09-21T07:07:57.668365+0000","last_clean":"2024-09-21T07:07:57.668365+0000","last_became_active":"2024-09-21T07:07:32.560269+0000","last_became_peered":"2024-09-21T07:07:32.560269+0000","last_unstale":"2024-09-21T07:07:57.668365+0000","last_undegraded":"2024-09-21T07:07:57.668365+0000","last_fullsized":"2024-09-21T07:07:57.668365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:40.109644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666042+0000","last_change":"2024-09-21T07:07:30.543936+0000","last_active":"2024-09-21T07:07:57.666042+0000","last_peered":"2024-09-21T07:07:57.666042+0000","last_clean":"2024-09-21T07:07:57.666042+0000","last_became_active":"2024-09-21T07:07:30.543530+0000","last_became_peered":"2024-09-21T07:07:30.543530+0000","last_unstale":"2024-09-21T07:07:57.666042+0000","last_undegraded":"2024-09-21T07:07:57.666042+0000","last_fullsized":"2024-09-21T07:07:57.666042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:02.312471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663848+0000","last_change":"2024-09-21T07:07:32.542182+0000","last_active":"2024-09-21T07:07:57.663848+0000","last_peered":"2024-09-21T07:07:57.663848+0000","last_clean":"2024-09-21T07:07:57.663848+0000","last_became_active":"2024-09-21T07:07:32.541750+0000","last_became_peered":"2024-09-21T07:07:32.541750+0000","last_unstale":"2024-09-21T07:07:57.663848+0000","last_undegraded":"2024-09-21T07:07:57.663848+0000","last_fullsized":"2024-09-21T07:07:57.663848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.184712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":46,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:59.660160+0000","last_change":"2024-09-21T07:07:30.754978+0000","last_active":"2024-09-21T07:07:59.660160+0000","last_peered":"2024-09-21T07:07:59.660160+0000","last_clean":"2024-09-21T07:07:59.660160+0000","last_became_active":"2024-09-21T07:07:30.754149+0000","last_became_peered":"2024-09-21T07:07:30.754149+0000","last_unstale":"2024-09-21T07:07:59.660160+0000","last_undegraded":"2024-09-21T07:07:59.660160+0000","last_fullsized":"2024-09-21T07:07:59.660160+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:36.140237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668604+0000","last_change":"2024-09-21T07:07:32.570424+0000","last_active":"2024-09-21T07:07:57.668604+0000","last_peered":"2024-09-21T07:07:57.668604+0000","last_clean":"2024-09-21T07:07:57.668604+0000","last_became_active":"2024-09-21T07:07:32.570029+0000","last_became_peered":"2024-09-21T07:07:32.570029+0000","last_unstale":"2024-09-21T07:07:57.668604+0000","last_undegraded":"2024-09-21T07:07:57.668604+0000","last_fullsized":"2024-09-21T07:07:57.668604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:09.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:59.659369+0000","last_change":"2024-09-21T07:07:30.543963+0000","last_active":"2024-09-21T07:07:59.659369+0000","last_peered":"2024-09-21T07:07:59.659369+0000","last_clean":"2024-09-21T07:07:59.659369+0000","last_became_active":"2024-09-21T07:07:30.543586+0000","last_became_peered":"2024-09-21T07:07:30.543586+0000","last_unstale":"2024-09-21T07:07:59.659369+0000","last_undegraded":"2024-09-21T07:07:59.659369+0000","last_fullsized":"2024-09-21T07:07:59.659369+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:05.782005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662307+0000","last_change":"2024-09-21T07:07:32.556132+0000","last_active":"2024-09-21T07:07:57.662307+0000","last_peered":"2024-09-21T07:07:57.662307+0000","last_clean":"2024-09-21T07:07:57.662307+0000","last_became_active":"2024-09-21T07:07:32.555717+0000","last_became_peered":"2024-09-21T07:07:32.555717+0000","last_unstale":"2024-09-21T07:07:57.662307+0000","last_undegraded":"2024-09-21T07:07:57.662307+0000","last_fullsized":"2024-09-21T07:07:57.662307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.809268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661088+0000","last_change":"2024-09-21T07:07:30.755143+0000","last_active":"2024-09-21T07:07:57.661088+0000","last_peered":"2024-09-21T07:07:57.661088+0000","last_clean":"2024-09-21T07:07:57.661088+0000","last_became_active":"2024-09-21T07:07:30.754591+0000","last_became_peered":"2024-09-21T07:07:30.754591+0000","last_unstale":"2024-09-21T07:07:57.661088+0000","last_undegraded":"2024-09-21T07:07:57.661088+0000","last_fullsized":"2024-09-21T07:07:57.661088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:13.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662201+0000","last_change":"2024-09-21T07:07:32.552869+0000","last_active":"2024-09-21T07:07:57.662201+0000","last_peered":"2024-09-21T07:07:57.662201+0000","last_clean":"2024-09-21T07:07:57.662201+0000","last_became_active":"2024-09-21T07:07:32.552483+0000","last_became_peered":"2024-09-21T07:07:32.552483+0000","last_unstale":"2024-09-21T07:07:57.662201+0000","last_undegraded":"2024-09-21T07:07:57.662201+0000","last_fullsized":"2024-09-21T07:07:57.662201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:21.006847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665762+0000","last_change":"2024-09-21T07:07:30.755552+0000","last_active":"2024-09-21T07:07:57.665762+0000","last_peered":"2024-09-21T07:07:57.665762+0000","last_clean":"2024-09-21T07:07:57.665762+0000","last_became_active":"2024-09-21T07:07:30.754451+0000","last_became_peered":"2024-09-21T07:07:30.754451+0000","last_unstale":"2024-09-21T07:07:57.665762+0000","last_undegraded":"2024-09-21T07:07:57.665762+0000","last_fullsized":"2024-09-21T07:07:57.665762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:50.229649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664284+0000","last_change":"2024-09-21T07:07:32.543249+0000","last_active":"2024-09-21T07:07:57.664284+0000","last_peered":"2024-09-21T07:07:57.664284+0000","last_clean":"2024-09-21T07:07:57.664284+0000","last_became_active":"2024-09-21T07:07:32.542866+0000","last_became_peered":"2024-09-21T07:07:32.542866+0000","last_unstale":"2024-09-21T07:07:57.664284+0000","last_undegraded":"2024-09-21T07:07:57.664284+0000","last_fullsized":"2024-09-21T07:07:57.664284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:29.476454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661340+0000","last_change":"2024-09-21T07:07:30.541589+0000","last_active":"2024-09-21T07:07:57.661340+0000","last_peered":"2024-09-21T07:07:57.661340+0000","last_clean":"2024-09-21T07:07:57.661340+0000","last_became_active":"2024-09-21T07:07:30.541171+0000","last_became_peered":"2024-09-21T07:07:30.541171+0000","last_unstale":"2024-09-21T07:07:57.661340+0000","last_undegraded":"2024-09-21T07:07:57.661340+0000","last_fullsized":"2024-09-21T07:07:57.661340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:46.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668335+0000","last_change":"2024-09-21T07:07:32.558409+0000","last_active":"2024-09-21T07:07:57.668335+0000","last_peered":"2024-09-21T07:07:57.668335+0000","last_clean":"2024-09-21T07:07:57.668335+0000","last_became_active":"2024-09-21T07:07:32.557886+0000","last_became_peered":"2024-09-21T07:07:32.557886+0000","last_unstale":"2024-09-21T07:07:57.668335+0000","last_undegraded":"2024-09-21T07:07:57.668335+0000","last_fullsized":"2024-09-21T07:07:57.668335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.071651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668890+0000","last_change":"2024-09-21T07:07:30.536107+0000","last_active":"2024-09-21T07:07:57.668890+0000","last_peered":"2024-09-21T07:07:57.668890+0000","last_clean":"2024-09-21T07:07:57.668890+0000","last_became_active":"2024-09-21T07:07:30.535455+0000","last_became_peered":"2024-09-21T07:07:30.535455+0000","last_unstale":"2024-09-21T07:07:57.668890+0000","last_undegraded":"2024-09-21T07:07:57.668890+0000","last_fullsized":"2024-09-21T07:07:57.668890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:55.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700974+0000","last_change":"2024-09-21T07:07:32.553187+0000","last_active":"2024-09-21T07:07:57.700974+0000","last_peered":"2024-09-21T07:07:57.700974+0000","last_clean":"2024-09-21T07:07:57.700974+0000","last_became_active":"2024-09-21T07:07:32.552905+0000","last_became_peered":"2024-09-21T07:07:32.552905+0000","last_unstale":"2024-09-21T07:07:57.700974+0000","last_undegraded":"2024-09-21T07:07:57.700974+0000","last_fullsized":"2024-09-21T07:07:57.700974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:24.790329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670080+0000","last_change":"2024-09-21T07:07:30.754858+0000","last_active":"2024-09-21T07:07:57.670080+0000","last_peered":"2024-09-21T07:07:57.670080+0000","last_clean":"2024-09-21T07:07:57.670080+0000","last_became_active":"2024-09-21T07:07:30.754483+0000","last_became_peered":"2024-09-21T07:07:30.754483+0000","last_unstale":"2024-09-21T07:07:57.670080+0000","last_undegraded":"2024-09-21T07:07:57.670080+0000","last_fullsized":"2024-09-21T07:07:57.670080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:29.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664984+0000","last_change":"2024-09-21T07:07:32.562213+0000","last_active":"2024-09-21T07:07:57.664984+0000","last_peered":"2024-09-21T07:07:57.664984+0000","last_clean":"2024-09-21T07:07:57.664984+0000","last_became_active":"2024-09-21T07:07:32.561834+0000","last_became_peered":"2024-09-21T07:07:32.561834+0000","last_unstale":"2024-09-21T07:07:57.664984+0000","last_undegraded":"2024-09-21T07:07:57.664984+0000","last_fullsized":"2024-09-21T07:07:57.664984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:12.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668009+0000","last_change":"2024-09-21T07:07:30.543455+0000","last_active":"2024-09-21T07:07:57.668009+0000","last_peered":"2024-09-21T07:07:57.668009+0000","last_clean":"2024-09-21T07:07:57.668009+0000","last_became_active":"2024-09-21T07:07:30.543059+0000","last_became_peered":"2024-09-21T07:07:30.543059+0000","last_unstale":"2024-09-21T07:07:57.668009+0000","last_undegraded":"2024-09-21T07:07:57.668009+0000","last_fullsized":"2024-09-21T07:07:57.668009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.896121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664245+0000","last_change":"2024-09-21T07:07:32.560600+0000","last_active":"2024-09-21T07:07:57.664245+0000","last_peered":"2024-09-21T07:07:57.664245+0000","last_clean":"2024-09-21T07:07:57.664245+0000","last_became_active":"2024-09-21T07:07:32.560159+0000","last_became_peered":"2024-09-21T07:07:32.560159+0000","last_unstale":"2024-09-21T07:07:57.664245+0000","last_undegraded":"2024-09-21T07:07:57.664245+0000","last_fullsized":"2024-09-21T07:07:57.664245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.228180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.683341+0000","last_change":"2024-09-21T07:07:57.682685+0000","last_active":"2024-09-21T07:07:57.683341+0000","last_peered":"2024-09-21T07:07:57.683341+0000","last_clean":"2024-09-21T07:07:57.683341+0000","last_became_active":"2024-09-21T07:07:57.671259+0000","last_became_peered":"2024-09-21T07:07:57.671259+0000","last_unstale":"2024-09-21T07:07:57.683341+0000","last_undegraded":"2024-09-21T07:07:57.683341+0000","last_fullsized":"2024-09-21T07:07:57.683341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668076+0000","last_change":"2024-09-21T07:07:32.554033+0000","last_active":"2024-09-21T07:07:57.668076+0000","last_peered":"2024-09-21T07:07:57.668076+0000","last_clean":"2024-09-21T07:07:57.668076+0000","last_became_active":"2024-09-21T07:07:32.553654+0000","last_became_peered":"2024-09-21T07:07:32.553654+0000","last_unstale":"2024-09-21T07:07:57.668076+0000","last_undegraded":"2024-09-21T07:07:57.668076+0000","last_fullsized":"2024-09-21T07:07:57.668076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:15.876104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665390+0000","last_change":"2024-09-21T07:07:30.547818+0000","last_active":"2024-09-21T07:07:57.665390+0000","last_peered":"2024-09-21T07:07:57.665390+0000","last_clean":"2024-09-21T07:07:57.665390+0000","last_became_active":"2024-09-21T07:07:30.547387+0000","last_became_peered":"2024-09-21T07:07:30.547387+0000","last_unstale":"2024-09-21T07:07:57.665390+0000","last_undegraded":"2024-09-21T07:07:57.665390+0000","last_fullsized":"2024-09-21T07:07:57.665390+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666216+0000","last_change":"2024-09-21T07:07:32.566731+0000","last_active":"2024-09-21T07:07:57.666216+0000","last_peered":"2024-09-21T07:07:57.666216+0000","last_clean":"2024-09-21T07:07:57.666216+0000","last_became_active":"2024-09-21T07:07:32.566233+0000","last_became_peered":"2024-09-21T07:07:32.566233+0000","last_unstale":"2024-09-21T07:07:57.666216+0000","last_undegraded":"2024-09-21T07:07:57.666216+0000","last_fullsized":"2024-09-21T07:07:57.666216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:57.630088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.673727+0000","last_change":"2024-09-21T07:07:57.673550+0000","last_active":"2024-09-21T07:07:57.673727+0000","last_peered":"2024-09-21T07:07:57.673727+0000","last_clean":"2024-09-21T07:07:57.673727+0000","last_became_active":"2024-09-21T07:07:57.673036+0000","last_became_peered":"2024-09-21T07:07:57.673036+0000","last_unstale":"2024-09-21T07:07:57.673727+0000","last_undegraded":"2024-09-21T07:07:57.673727+0000","last_fullsized":"2024-09-21T07:07:57.673727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:53.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665716+0000","last_change":"2024-09-21T07:07:30.544884+0000","last_active":"2024-09-21T07:07:57.665716+0000","last_peered":"2024-09-21T07:07:57.665716+0000","last_clean":"2024-09-21T07:07:57.665716+0000","last_became_active":"2024-09-21T07:07:30.543321+0000","last_became_peered":"2024-09-21T07:07:30.543321+0000","last_unstale":"2024-09-21T07:07:57.665716+0000","last_undegraded":"2024-09-21T07:07:57.665716+0000","last_fullsized":"2024-09-21T07:07:57.665716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.234905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670015+0000","last_change":"2024-09-21T07:07:32.566124+0000","last_active":"2024-09-21T07:07:57.670015+0000","last_peered":"2024-09-21T07:07:57.670015+0000","last_clean":"2024-09-21T07:07:57.670015+0000","last_became_active":"2024-09-21T07:07:32.565743+0000","last_became_peered":"2024-09-21T07:07:32.565743+0000","last_unstale":"2024-09-21T07:07:57.670015+0000","last_undegraded":"2024-09-21T07:07:57.670015+0000","last_fullsized":"2024-09-21T07:07:57.670015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:57.048529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665685+0000","last_change":"2024-09-21T07:07:30.546742+0000","last_active":"2024-09-21T07:07:57.665685+0000","last_peered":"2024-09-21T07:07:57.665685+0000","last_clean":"2024-09-21T07:07:57.665685+0000","last_became_active":"2024-09-21T07:07:30.546300+0000","last_became_peered":"2024-09-21T07:07:30.546300+0000","last_unstale":"2024-09-21T07:07:57.665685+0000","last_undegraded":"2024-09-21T07:07:57.665685+0000","last_fullsized":"2024-09-21T07:07:57.665685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:58.903582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701061+0000","last_change":"2024-09-21T07:07:32.565602+0000","last_active":"2024-09-21T07:07:57.701061+0000","last_peered":"2024-09-21T07:07:57.701061+0000","last_clean":"2024-09-21T07:07:57.701061+0000","last_became_active":"2024-09-21T07:07:32.565252+0000","last_became_peered":"2024-09-21T07:07:32.565252+0000","last_unstale":"2024-09-21T07:07:57.701061+0000","last_undegraded":"2024-09-21T07:07:57.701061+0000","last_fullsized":"2024-09-21T07:07:57.701061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:50.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668572+0000","last_change":"2024-09-21T07:07:30.754535+0000","last_active":"2024-09-21T07:07:57.668572+0000","last_peered":"2024-09-21T07:07:57.668572+0000","last_clean":"2024-09-21T07:07:57.668572+0000","last_became_active":"2024-09-21T07:07:30.754129+0000","last_became_peered":"2024-09-21T07:07:30.754129+0000","last_unstale":"2024-09-21T07:07:57.668572+0000","last_undegraded":"2024-09-21T07:07:57.668572+0000","last_fullsized":"2024-09-21T07:07:57.668572+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:23.800713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668229+0000","last_change":"2024-09-21T07:07:32.561210+0000","last_active":"2024-09-21T07:07:57.668229+0000","last_peered":"2024-09-21T07:07:57.668229+0000","last_clean":"2024-09-21T07:07:57.668229+0000","last_became_active":"2024-09-21T07:07:32.560850+0000","last_became_peered":"2024-09-21T07:07:32.560850+0000","last_unstale":"2024-09-21T07:07:57.668229+0000","last_undegraded":"2024-09-21T07:07:57.668229+0000","last_fullsized":"2024-09-21T07:07:57.668229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.212097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:00.660037+0000","last_change":"2024-09-21T07:07:30.543778+0000","last_active":"2024-09-21T07:08:00.660037+0000","last_peered":"2024-09-21T07:08:00.660037+0000","last_clean":"2024-09-21T07:08:00.660037+0000","last_became_active":"2024-09-21T07:07:30.543474+0000","last_became_peered":"2024-09-21T07:07:30.543474+0000","last_unstale":"2024-09-21T07:08:00.660037+0000","last_undegraded":"2024-09-21T07:08:00.660037+0000","last_fullsized":"2024-09-21T07:08:00.660037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:06.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70364,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":203,"num_read_kb":167,"num_write":244,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":211092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808851,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":395386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972375,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40992,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704160,"statfs":{"total":95995035648,"available":95953059840,"internally_reserved":0,"allocated":1515520,"data_stored":1040648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":394903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332130,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":395259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528359,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1437696,"data_stored":988190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":395011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888113,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1449984,"data_stored":987086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":394872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":394445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":458913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":458693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40340,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704812,"statfs":{"total":95995035648,"available":95953727488,"internally_reserved":0,"allocated":847872,"data_stored":396350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:08:06.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:06 smithi052 ceph-mon[34308]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:07.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:06 smithi066 ceph-mon[34793]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:07.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:06 smithi029 ceph-mon[30983]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:07.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:07 smithi052 ceph-mon[34308]: pgmap v310: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:08.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:07 smithi066 ceph-mon[34793]: pgmap v310: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:08.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:07 smithi029 ceph-mon[30983]: pgmap v310: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:09.456 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:08:09.729 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:09.850 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:09 smithi029 ceph-mon[30983]: pgmap v311: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:09 smithi052 ceph-mon[34308]: pgmap v311: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:10.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:09 smithi066 ceph-mon[34793]: pgmap v311: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 -- 172.21.15.29:0/1242115033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb81083b0 msgr2=0x7fadb81087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 --2- 172.21.15.29:0/1242115033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb81083b0 0x7fadb81087c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fadac009900 tx=0x7fadac02a410 comp rx=0 tx=0).stop 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 -- 172.21.15.29:0/1242115033 shutdown_connections 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 --2- 172.21.15.29:0/1242115033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8108d00 0x7fadb810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 --2- 172.21.15.29:0/1242115033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb81083b0 0x7fadb81087c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 --2- 172.21.15.29:0/1242115033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadb8102ac0 0x7fadb8102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 -- 172.21.15.29:0/1242115033 >> 172.21.15.29:0/1242115033 conn(0x7fadb8079720 msgr2=0x7fadb8079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:10.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 -- 172.21.15.29:0/1242115033 shutdown_connections 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.193+0000 7fadbd290640 1 -- 172.21.15.29:0/1242115033 wait complete. 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 Processor -- start 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 -- start start 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8102ac0 0x7fadb819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadb81083b0 0x7fadb819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb8108d00 0x7fadb819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fadb81129c0 con 0x7fadb8108d00 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8112840 con 0x7fadb8102ac0 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadbd290640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fadb8112b40 con 0x7fadb81083b0 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadb77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb8108d00 0x7fadb819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadb77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb8108d00 0x7fadb819bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45476/0 (socket says 172.21.15.29:45476) 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadb77fe640 1 -- 172.21.15.29:0/337597555 learned_addr learned my addr 172.21.15.29:0/337597555 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadb67fc640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadb81083b0 0x7fadb819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:10.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.194+0000 7fadb6ffd640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8102ac0 0x7fadb819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadb77fe640 1 -- 172.21.15.29:0/337597555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadb81083b0 msgr2=0x7fadb819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadb77fe640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadb81083b0 0x7fadb819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadb77fe640 1 -- 172.21.15.29:0/337597555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8102ac0 msgr2=0x7fadb819b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadb77fe640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8102ac0 0x7fadb819b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadb77fe640 1 -- 172.21.15.29:0/337597555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb81a6570 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadb77fe640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb8108d00 0x7fadb819bd30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadb000eaa0 tx=0x7fadb000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fad9ffff640 1 -- 172.21.15.29:0/337597555 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000cdb0 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb81a6860 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fad9ffff640 1 -- 172.21.15.29:0/337597555 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadb0005020 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fad9ffff640 1 -- 172.21.15.29:0/337597555 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb00116d0 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.195+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb81a6d70 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.196+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb8102ed0 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.198+0000 7fad9ffff640 1 -- 172.21.15.29:0/337597555 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fadb00051d0 con 0x7fadb8108d00 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.199+0000 7fad9ffff640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fada00b65a0 0x7fada00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:10.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.199+0000 7fadb6ffd640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fada00b65a0 0x7fada00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:10.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.199+0000 7fad9ffff640 1 -- 172.21.15.29:0/337597555 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fadb00e79b0 con 0x7fadb8108d00 2024-09-21T07:08:10.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.199+0000 7fadb6ffd640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fada00b65a0 0x7fada00b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fadb806c3a0 tx=0x7fada800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:10.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.202+0000 7fad9ffff640 1 -- 172.21.15.29:0/337597555 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fadb0016030 con 0x7fadb8108d00 2024-09-21T07:08:10.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.386+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadb8063800 con 0x7fada00b65a0 2024-09-21T07:08:10.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.391+0000 7fad9ffff640 1 -- 172.21.15.29:0/337597555 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258751 (secure 0 0 0) 0x7fadb8063800 con 0x7fada00b65a0 2024-09-21T07:08:10.395 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:10.396 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fada00b65a0 msgr2=0x7fada00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fada00b65a0 0x7fada00b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fadb806c3a0 tx=0x7fada800b410 comp rx=0 tx=0).stop 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb8108d00 msgr2=0x7fadb819bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb8108d00 0x7fadb819bd30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadb000eaa0 tx=0x7fadb000ef60 comp rx=0 tx=0).stop 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 shutdown_connections 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fada00b65a0 0x7fada00b8ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadb8108d00 0x7fadb819bd30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadb81083b0 0x7fadb819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 --2- 172.21.15.29:0/337597555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadb8102ac0 0x7fadb819b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:10.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 >> 172.21.15.29:0/337597555 conn(0x7fadb8079720 msgr2=0x7fadb8104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:10.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 shutdown_connections 2024-09-21T07:08:10.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:10.394+0000 7fadbd290640 1 -- 172.21.15.29:0/337597555 wait complete. 2024-09-21T07:08:11.194 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-21T07:08:10.015738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662954,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":351,"num_read_kb":282,"num_write":371,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386052,"kb_used_data":11784,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555772,"statfs":{"total":1151940427776,"available":1151545110528,"internally_reserved":0,"allocated":12066816,"data_stored":6714234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10502,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":84,"num_write":5,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.018184"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665830+0000","last_change":"2024-09-21T07:07:32.566786+0000","last_active":"2024-09-21T07:07:57.665830+0000","last_peered":"2024-09-21T07:07:57.665830+0000","last_clean":"2024-09-21T07:07:57.665830+0000","last_became_active":"2024-09-21T07:07:32.565722+0000","last_became_peered":"2024-09-21T07:07:32.565722+0000","last_unstale":"2024-09-21T07:07:57.665830+0000","last_undegraded":"2024-09-21T07:07:57.665830+0000","last_fullsized":"2024-09-21T07:07:57.665830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:22.389773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700880+0000","last_change":"2024-09-21T07:07:32.556460+0000","last_active":"2024-09-21T07:07:57.700880+0000","last_peered":"2024-09-21T07:07:57.700880+0000","last_clean":"2024-09-21T07:07:57.700880+0000","last_became_active":"2024-09-21T07:07:32.555738+0000","last_became_peered":"2024-09-21T07:07:32.555738+0000","last_unstale":"2024-09-21T07:07:57.700880+0000","last_undegraded":"2024-09-21T07:07:57.700880+0000","last_fullsized":"2024-09-21T07:07:57.700880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.921413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700779+0000","last_change":"2024-09-21T07:07:32.565814+0000","last_active":"2024-09-21T07:07:57.700779+0000","last_peered":"2024-09-21T07:07:57.700779+0000","last_clean":"2024-09-21T07:07:57.700779+0000","last_became_active":"2024-09-21T07:07:32.565401+0000","last_became_peered":"2024-09-21T07:07:32.565401+0000","last_unstale":"2024-09-21T07:07:57.700779+0000","last_undegraded":"2024-09-21T07:07:57.700779+0000","last_fullsized":"2024-09-21T07:07:57.700779+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:56.705903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668559+0000","last_change":"2024-09-21T07:07:32.554713+0000","last_active":"2024-09-21T07:07:57.668559+0000","last_peered":"2024-09-21T07:07:57.668559+0000","last_clean":"2024-09-21T07:07:57.668559+0000","last_became_active":"2024-09-21T07:07:32.554203+0000","last_became_peered":"2024-09-21T07:07:32.554203+0000","last_unstale":"2024-09-21T07:07:57.668559+0000","last_undegraded":"2024-09-21T07:07:57.668559+0000","last_fullsized":"2024-09-21T07:07:57.668559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:29.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665134+0000","last_change":"2024-09-21T07:07:32.566048+0000","last_active":"2024-09-21T07:07:57.665134+0000","last_peered":"2024-09-21T07:07:57.665134+0000","last_clean":"2024-09-21T07:07:57.665134+0000","last_became_active":"2024-09-21T07:07:32.565659+0000","last_became_peered":"2024-09-21T07:07:32.565659+0000","last_unstale":"2024-09-21T07:07:57.665134+0000","last_undegraded":"2024-09-21T07:07:57.665134+0000","last_fullsized":"2024-09-21T07:07:57.665134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:56.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662196+0000","last_change":"2024-09-21T07:07:32.550492+0000","last_active":"2024-09-21T07:07:57.662196+0000","last_peered":"2024-09-21T07:07:57.662196+0000","last_clean":"2024-09-21T07:07:57.662196+0000","last_became_active":"2024-09-21T07:07:32.549691+0000","last_became_peered":"2024-09-21T07:07:32.549691+0000","last_unstale":"2024-09-21T07:07:57.662196+0000","last_undegraded":"2024-09-21T07:07:57.662196+0000","last_fullsized":"2024-09-21T07:07:57.662196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.890164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665985+0000","last_change":"2024-09-21T07:07:32.560258+0000","last_active":"2024-09-21T07:07:57.665985+0000","last_peered":"2024-09-21T07:07:57.665985+0000","last_clean":"2024-09-21T07:07:57.665985+0000","last_became_active":"2024-09-21T07:07:32.559890+0000","last_became_peered":"2024-09-21T07:07:32.559890+0000","last_unstale":"2024-09-21T07:07:57.665985+0000","last_undegraded":"2024-09-21T07:07:57.665985+0000","last_fullsized":"2024-09-21T07:07:57.665985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.794736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667805+0000","last_change":"2024-09-21T07:07:32.560923+0000","last_active":"2024-09-21T07:07:57.667805+0000","last_peered":"2024-09-21T07:07:57.667805+0000","last_clean":"2024-09-21T07:07:57.667805+0000","last_became_active":"2024-09-21T07:07:32.560509+0000","last_became_peered":"2024-09-21T07:07:32.560509+0000","last_unstale":"2024-09-21T07:07:57.667805+0000","last_undegraded":"2024-09-21T07:07:57.667805+0000","last_fullsized":"2024-09-21T07:07:57.667805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:59.576434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670812+0000","last_change":"2024-09-21T07:07:32.564475+0000","last_active":"2024-09-21T07:07:57.670812+0000","last_peered":"2024-09-21T07:07:57.670812+0000","last_clean":"2024-09-21T07:07:57.670812+0000","last_became_active":"2024-09-21T07:07:32.564115+0000","last_became_peered":"2024-09-21T07:07:32.564115+0000","last_unstale":"2024-09-21T07:07:57.670812+0000","last_undegraded":"2024-09-21T07:07:57.670812+0000","last_fullsized":"2024-09-21T07:07:57.670812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:03.989109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662889+0000","last_change":"2024-09-21T07:07:32.557377+0000","last_active":"2024-09-21T07:07:57.662889+0000","last_peered":"2024-09-21T07:07:57.662889+0000","last_clean":"2024-09-21T07:07:57.662889+0000","last_became_active":"2024-09-21T07:07:32.556732+0000","last_became_peered":"2024-09-21T07:07:32.556732+0000","last_unstale":"2024-09-21T07:07:57.662889+0000","last_undegraded":"2024-09-21T07:07:57.662889+0000","last_fullsized":"2024-09-21T07:07:57.662889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:32.474690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666465+0000","last_change":"2024-09-21T07:07:32.558691+0000","last_active":"2024-09-21T07:07:57.666465+0000","last_peered":"2024-09-21T07:07:57.666465+0000","last_clean":"2024-09-21T07:07:57.666465+0000","last_became_active":"2024-09-21T07:07:32.558029+0000","last_became_peered":"2024-09-21T07:07:32.558029+0000","last_unstale":"2024-09-21T07:07:57.666465+0000","last_undegraded":"2024-09-21T07:07:57.666465+0000","last_fullsized":"2024-09-21T07:07:57.666465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.378786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668606+0000","last_change":"2024-09-21T07:07:32.556500+0000","last_active":"2024-09-21T07:07:57.668606+0000","last_peered":"2024-09-21T07:07:57.668606+0000","last_clean":"2024-09-21T07:07:57.668606+0000","last_became_active":"2024-09-21T07:07:32.555529+0000","last_became_peered":"2024-09-21T07:07:32.555529+0000","last_unstale":"2024-09-21T07:07:57.668606+0000","last_undegraded":"2024-09-21T07:07:57.668606+0000","last_fullsized":"2024-09-21T07:07:57.668606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.494498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664151+0000","last_change":"2024-09-21T07:07:32.560235+0000","last_active":"2024-09-21T07:07:57.664151+0000","last_peered":"2024-09-21T07:07:57.664151+0000","last_clean":"2024-09-21T07:07:57.664151+0000","last_became_active":"2024-09-21T07:07:32.559834+0000","last_became_peered":"2024-09-21T07:07:32.559834+0000","last_unstale":"2024-09-21T07:07:57.664151+0000","last_undegraded":"2024-09-21T07:07:57.664151+0000","last_fullsized":"2024-09-21T07:07:57.664151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:30.090878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700558+0000","last_change":"2024-09-21T07:07:32.554158+0000","last_active":"2024-09-21T07:07:57.700558+0000","last_peered":"2024-09-21T07:07:57.700558+0000","last_clean":"2024-09-21T07:07:57.700558+0000","last_became_active":"2024-09-21T07:07:32.553837+0000","last_became_peered":"2024-09-21T07:07:32.553837+0000","last_unstale":"2024-09-21T07:07:57.700558+0000","last_undegraded":"2024-09-21T07:07:57.700558+0000","last_fullsized":"2024-09-21T07:07:57.700558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:23.845629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700519+0000","last_change":"2024-09-21T07:07:32.556921+0000","last_active":"2024-09-21T07:07:57.700519+0000","last_peered":"2024-09-21T07:07:57.700519+0000","last_clean":"2024-09-21T07:07:57.700519+0000","last_became_active":"2024-09-21T07:07:32.556529+0000","last_became_peered":"2024-09-21T07:07:32.556529+0000","last_unstale":"2024-09-21T07:07:57.700519+0000","last_undegraded":"2024-09-21T07:07:57.700519+0000","last_fullsized":"2024-09-21T07:07:57.700519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.447617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669857+0000","last_change":"2024-09-21T07:07:32.567572+0000","last_active":"2024-09-21T07:07:57.669857+0000","last_peered":"2024-09-21T07:07:57.669857+0000","last_clean":"2024-09-21T07:07:57.669857+0000","last_became_active":"2024-09-21T07:07:32.567159+0000","last_became_peered":"2024-09-21T07:07:32.567159+0000","last_unstale":"2024-09-21T07:07:57.669857+0000","last_undegraded":"2024-09-21T07:07:57.669857+0000","last_fullsized":"2024-09-21T07:07:57.669857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.316539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665990+0000","last_change":"2024-09-21T07:07:32.567213+0000","last_active":"2024-09-21T07:07:57.665990+0000","last_peered":"2024-09-21T07:07:57.665990+0000","last_clean":"2024-09-21T07:07:57.665990+0000","last_became_active":"2024-09-21T07:07:32.566284+0000","last_became_peered":"2024-09-21T07:07:32.566284+0000","last_unstale":"2024-09-21T07:07:57.665990+0000","last_undegraded":"2024-09-21T07:07:57.665990+0000","last_fullsized":"2024-09-21T07:07:57.665990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661267+0000","last_change":"2024-09-21T07:07:32.551695+0000","last_active":"2024-09-21T07:07:57.661267+0000","last_peered":"2024-09-21T07:07:57.661267+0000","last_clean":"2024-09-21T07:07:57.661267+0000","last_became_active":"2024-09-21T07:07:32.551282+0000","last_became_peered":"2024-09-21T07:07:32.551282+0000","last_unstale":"2024-09-21T07:07:57.661267+0000","last_undegraded":"2024-09-21T07:07:57.661267+0000","last_fullsized":"2024-09-21T07:07:57.661267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:33.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669799+0000","last_change":"2024-09-21T07:07:32.551000+0000","last_active":"2024-09-21T07:07:57.669799+0000","last_peered":"2024-09-21T07:07:57.669799+0000","last_clean":"2024-09-21T07:07:57.669799+0000","last_became_active":"2024-09-21T07:07:32.550590+0000","last_became_peered":"2024-09-21T07:07:32.550590+0000","last_unstale":"2024-09-21T07:07:57.669799+0000","last_undegraded":"2024-09-21T07:07:57.669799+0000","last_fullsized":"2024-09-21T07:07:57.669799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:30.213470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668399+0000","last_change":"2024-09-21T07:07:57.668284+0000","last_active":"2024-09-21T07:07:57.668399+0000","last_peered":"2024-09-21T07:07:57.668399+0000","last_clean":"2024-09-21T07:07:57.668399+0000","last_became_active":"2024-09-21T07:07:57.667145+0000","last_became_peered":"2024-09-21T07:07:57.667145+0000","last_unstale":"2024-09-21T07:07:57.668399+0000","last_undegraded":"2024-09-21T07:07:57.668399+0000","last_fullsized":"2024-09-21T07:07:57.668399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:11.662321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664164+0000","last_change":"2024-09-21T07:07:32.555752+0000","last_active":"2024-09-21T07:07:57.664164+0000","last_peered":"2024-09-21T07:07:57.664164+0000","last_clean":"2024-09-21T07:07:57.664164+0000","last_became_active":"2024-09-21T07:07:32.555057+0000","last_became_peered":"2024-09-21T07:07:32.555057+0000","last_unstale":"2024-09-21T07:07:57.664164+0000","last_undegraded":"2024-09-21T07:07:57.664164+0000","last_fullsized":"2024-09-21T07:07:57.664164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:03.161990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670600+0000","last_change":"2024-09-21T07:07:32.555589+0000","last_active":"2024-09-21T07:07:57.670600+0000","last_peered":"2024-09-21T07:07:57.670600+0000","last_clean":"2024-09-21T07:07:57.670600+0000","last_became_active":"2024-09-21T07:07:32.555037+0000","last_became_peered":"2024-09-21T07:07:32.555037+0000","last_unstale":"2024-09-21T07:07:57.670600+0000","last_undegraded":"2024-09-21T07:07:57.670600+0000","last_fullsized":"2024-09-21T07:07:57.670600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:25.346546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667780+0000","last_change":"2024-09-21T07:07:32.559407+0000","last_active":"2024-09-21T07:07:57.667780+0000","last_peered":"2024-09-21T07:07:57.667780+0000","last_clean":"2024-09-21T07:07:57.667780+0000","last_became_active":"2024-09-21T07:07:32.559112+0000","last_became_peered":"2024-09-21T07:07:32.559112+0000","last_unstale":"2024-09-21T07:07:57.667780+0000","last_undegraded":"2024-09-21T07:07:57.667780+0000","last_fullsized":"2024-09-21T07:07:57.667780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:13.970511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669197+0000","last_change":"2024-09-21T07:07:32.564798+0000","last_active":"2024-09-21T07:07:57.669197+0000","last_peered":"2024-09-21T07:07:57.669197+0000","last_clean":"2024-09-21T07:07:57.669197+0000","last_became_active":"2024-09-21T07:07:32.564381+0000","last_became_peered":"2024-09-21T07:07:32.564381+0000","last_unstale":"2024-09-21T07:07:57.669197+0000","last_undegraded":"2024-09-21T07:07:57.669197+0000","last_fullsized":"2024-09-21T07:07:57.669197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:19.667252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668233+0000","last_change":"2024-09-21T07:07:32.555274+0000","last_active":"2024-09-21T07:07:57.668233+0000","last_peered":"2024-09-21T07:07:57.668233+0000","last_clean":"2024-09-21T07:07:57.668233+0000","last_became_active":"2024-09-21T07:07:32.554816+0000","last_became_peered":"2024-09-21T07:07:32.554816+0000","last_unstale":"2024-09-21T07:07:57.668233+0000","last_undegraded":"2024-09-21T07:07:57.668233+0000","last_fullsized":"2024-09-21T07:07:57.668233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.018974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.671064+0000","last_change":"2024-09-21T07:07:32.555655+0000","last_active":"2024-09-21T07:07:57.671064+0000","last_peered":"2024-09-21T07:07:57.671064+0000","last_clean":"2024-09-21T07:07:57.671064+0000","last_became_active":"2024-09-21T07:07:32.555240+0000","last_became_peered":"2024-09-21T07:07:32.555240+0000","last_unstale":"2024-09-21T07:07:57.671064+0000","last_undegraded":"2024-09-21T07:07:57.671064+0000","last_fullsized":"2024-09-21T07:07:57.671064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:51.550091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664496+0000","last_change":"2024-09-21T07:07:32.570761+0000","last_active":"2024-09-21T07:07:57.664496+0000","last_peered":"2024-09-21T07:07:57.664496+0000","last_clean":"2024-09-21T07:07:57.664496+0000","last_became_active":"2024-09-21T07:07:32.569555+0000","last_became_peered":"2024-09-21T07:07:32.569555+0000","last_unstale":"2024-09-21T07:07:57.664496+0000","last_undegraded":"2024-09-21T07:07:57.664496+0000","last_fullsized":"2024-09-21T07:07:57.664496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:23.414096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.702052+0000","last_change":"2024-09-21T07:07:57.701944+0000","last_active":"2024-09-21T07:07:57.702052+0000","last_peered":"2024-09-21T07:07:57.702052+0000","last_clean":"2024-09-21T07:07:57.702052+0000","last_became_active":"2024-09-21T07:07:57.701461+0000","last_became_peered":"2024-09-21T07:07:57.701461+0000","last_unstale":"2024-09-21T07:07:57.702052+0000","last_undegraded":"2024-09-21T07:07:57.702052+0000","last_fullsized":"2024-09-21T07:07:57.702052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:36.219766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700760+0000","last_change":"2024-09-21T07:07:32.550889+0000","last_active":"2024-09-21T07:07:57.700760+0000","last_peered":"2024-09-21T07:07:57.700760+0000","last_clean":"2024-09-21T07:07:57.700760+0000","last_became_active":"2024-09-21T07:07:32.550559+0000","last_became_peered":"2024-09-21T07:07:32.550559+0000","last_unstale":"2024-09-21T07:07:57.700760+0000","last_undegraded":"2024-09-21T07:07:57.700760+0000","last_fullsized":"2024-09-21T07:07:57.700760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:35.575626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669528+0000","last_change":"2024-09-21T07:07:32.552019+0000","last_active":"2024-09-21T07:07:57.669528+0000","last_peered":"2024-09-21T07:07:57.669528+0000","last_clean":"2024-09-21T07:07:57.669528+0000","last_became_active":"2024-09-21T07:07:32.551562+0000","last_became_peered":"2024-09-21T07:07:32.551562+0000","last_unstale":"2024-09-21T07:07:57.669528+0000","last_undegraded":"2024-09-21T07:07:57.669528+0000","last_fullsized":"2024-09-21T07:07:57.669528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:25.932560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669832+0000","last_change":"2024-09-21T07:07:32.556938+0000","last_active":"2024-09-21T07:07:57.669832+0000","last_peered":"2024-09-21T07:07:57.669832+0000","last_clean":"2024-09-21T07:07:57.669832+0000","last_became_active":"2024-09-21T07:07:32.556331+0000","last_became_peered":"2024-09-21T07:07:32.556331+0000","last_unstale":"2024-09-21T07:07:57.669832+0000","last_undegraded":"2024-09-21T07:07:57.669832+0000","last_fullsized":"2024-09-21T07:07:57.669832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.358076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664137+0000","last_change":"2024-09-21T07:07:32.561984+0000","last_active":"2024-09-21T07:07:57.664137+0000","last_peered":"2024-09-21T07:07:57.664137+0000","last_clean":"2024-09-21T07:07:57.664137+0000","last_became_active":"2024-09-21T07:07:32.561227+0000","last_became_peered":"2024-09-21T07:07:32.561227+0000","last_unstale":"2024-09-21T07:07:57.664137+0000","last_undegraded":"2024-09-21T07:07:57.664137+0000","last_fullsized":"2024-09-21T07:07:57.664137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:35.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666875+0000","last_change":"2024-09-21T07:07:32.567454+0000","last_active":"2024-09-21T07:07:57.666875+0000","last_peered":"2024-09-21T07:07:57.666875+0000","last_clean":"2024-09-21T07:07:57.666875+0000","last_became_active":"2024-09-21T07:07:32.567063+0000","last_became_peered":"2024-09-21T07:07:32.567063+0000","last_unstale":"2024-09-21T07:07:57.666875+0000","last_undegraded":"2024-09-21T07:07:57.666875+0000","last_fullsized":"2024-09-21T07:07:57.666875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.466771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:04.667633+0000","last_change":"2024-09-21T07:07:30.548785+0000","last_active":"2024-09-21T07:08:04.667633+0000","last_peered":"2024-09-21T07:08:04.667633+0000","last_clean":"2024-09-21T07:08:04.667633+0000","last_became_active":"2024-09-21T07:07:30.547764+0000","last_became_peered":"2024-09-21T07:07:30.547764+0000","last_unstale":"2024-09-21T07:08:04.667633+0000","last_undegraded":"2024-09-21T07:08:04.667633+0000","last_fullsized":"2024-09-21T07:08:04.667633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:18.115002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669774+0000","last_change":"2024-09-21T07:07:57.669607+0000","last_active":"2024-09-21T07:07:57.669774+0000","last_peered":"2024-09-21T07:07:57.669774+0000","last_clean":"2024-09-21T07:07:57.669774+0000","last_became_active":"2024-09-21T07:07:57.669149+0000","last_became_peered":"2024-09-21T07:07:57.669149+0000","last_unstale":"2024-09-21T07:07:57.669774+0000","last_undegraded":"2024-09-21T07:07:57.669774+0000","last_fullsized":"2024-09-21T07:07:57.669774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:20.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.686559+0000","last_change":"2024-09-21T07:07:57.686466+0000","last_active":"2024-09-21T07:07:57.686559+0000","last_peered":"2024-09-21T07:07:57.686559+0000","last_clean":"2024-09-21T07:07:57.686559+0000","last_became_active":"2024-09-21T07:07:57.671977+0000","last_became_peered":"2024-09-21T07:07:57.671977+0000","last_unstale":"2024-09-21T07:07:57.686559+0000","last_undegraded":"2024-09-21T07:07:57.686559+0000","last_fullsized":"2024-09-21T07:07:57.686559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:26.134854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663868+0000","last_change":"2024-09-21T07:07:30.539941+0000","last_active":"2024-09-21T07:07:57.663868+0000","last_peered":"2024-09-21T07:07:57.663868+0000","last_clean":"2024-09-21T07:07:57.663868+0000","last_became_active":"2024-09-21T07:07:30.539401+0000","last_became_peered":"2024-09-21T07:07:30.539401+0000","last_unstale":"2024-09-21T07:07:57.663868+0000","last_undegraded":"2024-09-21T07:07:57.663868+0000","last_fullsized":"2024-09-21T07:07:57.663868+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:15.184453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667870+0000","last_change":"2024-09-21T07:07:32.556958+0000","last_active":"2024-09-21T07:07:57.667870+0000","last_peered":"2024-09-21T07:07:57.667870+0000","last_clean":"2024-09-21T07:07:57.667870+0000","last_became_active":"2024-09-21T07:07:32.556581+0000","last_became_peered":"2024-09-21T07:07:32.556581+0000","last_unstale":"2024-09-21T07:07:57.667870+0000","last_undegraded":"2024-09-21T07:07:57.667870+0000","last_fullsized":"2024-09-21T07:07:57.667870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:57.618263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668760+0000","last_change":"2024-09-21T07:07:30.547760+0000","last_active":"2024-09-21T07:07:57.668760+0000","last_peered":"2024-09-21T07:07:57.668760+0000","last_clean":"2024-09-21T07:07:57.668760+0000","last_became_active":"2024-09-21T07:07:30.547327+0000","last_became_peered":"2024-09-21T07:07:30.547327+0000","last_unstale":"2024-09-21T07:07:57.668760+0000","last_undegraded":"2024-09-21T07:07:57.668760+0000","last_fullsized":"2024-09-21T07:07:57.668760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:01.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.660833+0000","last_change":"2024-09-21T07:07:32.552691+0000","last_active":"2024-09-21T07:07:57.660833+0000","last_peered":"2024-09-21T07:07:57.660833+0000","last_clean":"2024-09-21T07:07:57.660833+0000","last_became_active":"2024-09-21T07:07:32.552321+0000","last_became_peered":"2024-09-21T07:07:32.552321+0000","last_unstale":"2024-09-21T07:07:57.660833+0000","last_undegraded":"2024-09-21T07:07:57.660833+0000","last_fullsized":"2024-09-21T07:07:57.660833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:56.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:08.672747+0000","last_change":"2024-09-21T07:07:30.545281+0000","last_active":"2024-09-21T07:08:08.672747+0000","last_peered":"2024-09-21T07:08:08.672747+0000","last_clean":"2024-09-21T07:08:08.672747+0000","last_became_active":"2024-09-21T07:07:30.544823+0000","last_became_peered":"2024-09-21T07:07:30.544823+0000","last_unstale":"2024-09-21T07:08:08.672747+0000","last_undegraded":"2024-09-21T07:08:08.672747+0000","last_fullsized":"2024-09-21T07:08:08.672747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.659421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670838+0000","last_change":"2024-09-21T07:07:32.567833+0000","last_active":"2024-09-21T07:07:57.670838+0000","last_peered":"2024-09-21T07:07:57.670838+0000","last_clean":"2024-09-21T07:07:57.670838+0000","last_became_active":"2024-09-21T07:07:32.566902+0000","last_became_peered":"2024-09-21T07:07:32.566902+0000","last_unstale":"2024-09-21T07:07:57.670838+0000","last_undegraded":"2024-09-21T07:07:57.670838+0000","last_fullsized":"2024-09-21T07:07:57.670838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.871038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.681468+0000","last_change":"2024-09-21T07:07:57.681319+0000","last_active":"2024-09-21T07:07:57.681468+0000","last_peered":"2024-09-21T07:07:57.681468+0000","last_clean":"2024-09-21T07:07:57.681468+0000","last_became_active":"2024-09-21T07:07:57.671744+0000","last_became_peered":"2024-09-21T07:07:57.671744+0000","last_unstale":"2024-09-21T07:07:57.681468+0000","last_undegraded":"2024-09-21T07:07:57.681468+0000","last_fullsized":"2024-09-21T07:07:57.681468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:51.145118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701091+0000","last_change":"2024-09-21T07:07:32.561445+0000","last_active":"2024-09-21T07:07:57.701091+0000","last_peered":"2024-09-21T07:07:57.701091+0000","last_clean":"2024-09-21T07:07:57.701091+0000","last_became_active":"2024-09-21T07:07:32.561033+0000","last_became_peered":"2024-09-21T07:07:32.561033+0000","last_unstale":"2024-09-21T07:07:57.701091+0000","last_undegraded":"2024-09-21T07:07:57.701091+0000","last_fullsized":"2024-09-21T07:07:57.701091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:30.261234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668524+0000","last_change":"2024-09-21T07:07:30.755110+0000","last_active":"2024-09-21T07:07:57.668524+0000","last_peered":"2024-09-21T07:07:57.668524+0000","last_clean":"2024-09-21T07:07:57.668524+0000","last_became_active":"2024-09-21T07:07:30.754680+0000","last_became_peered":"2024-09-21T07:07:30.754680+0000","last_unstale":"2024-09-21T07:07:57.668524+0000","last_undegraded":"2024-09-21T07:07:57.668524+0000","last_fullsized":"2024-09-21T07:07:57.668524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.202010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670386+0000","last_change":"2024-09-21T07:07:32.557349+0000","last_active":"2024-09-21T07:07:57.670386+0000","last_peered":"2024-09-21T07:07:57.670386+0000","last_clean":"2024-09-21T07:07:57.670386+0000","last_became_active":"2024-09-21T07:07:32.554342+0000","last_became_peered":"2024-09-21T07:07:32.554342+0000","last_unstale":"2024-09-21T07:07:57.670386+0000","last_undegraded":"2024-09-21T07:07:57.670386+0000","last_fullsized":"2024-09-21T07:07:57.670386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:21.356410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":112,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:08.676783+0000","last_change":"2024-09-21T07:07:30.547691+0000","last_active":"2024-09-21T07:08:08.676783+0000","last_peered":"2024-09-21T07:08:08.676783+0000","last_clean":"2024-09-21T07:08:08.676783+0000","last_became_active":"2024-09-21T07:07:30.547280+0000","last_became_peered":"2024-09-21T07:07:30.547280+0000","last_unstale":"2024-09-21T07:08:08.676783+0000","last_undegraded":"2024-09-21T07:08:08.676783+0000","last_fullsized":"2024-09-21T07:08:08.676783+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:24.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64757,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":59,"num_read_kb":91,"num_write":32,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665578+0000","last_change":"2024-09-21T07:07:32.569291+0000","last_active":"2024-09-21T07:07:57.665578+0000","last_peered":"2024-09-21T07:07:57.665578+0000","last_clean":"2024-09-21T07:07:57.665578+0000","last_became_active":"2024-09-21T07:07:32.568503+0000","last_became_peered":"2024-09-21T07:07:32.568503+0000","last_unstale":"2024-09-21T07:07:57.665578+0000","last_undegraded":"2024-09-21T07:07:57.665578+0000","last_fullsized":"2024-09-21T07:07:57.665578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:56.184795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669620+0000","last_change":"2024-09-21T07:07:30.546624+0000","last_active":"2024-09-21T07:07:57.669620+0000","last_peered":"2024-09-21T07:07:57.669620+0000","last_clean":"2024-09-21T07:07:57.669620+0000","last_became_active":"2024-09-21T07:07:30.545497+0000","last_became_peered":"2024-09-21T07:07:30.545497+0000","last_unstale":"2024-09-21T07:07:57.669620+0000","last_undegraded":"2024-09-21T07:07:57.669620+0000","last_fullsized":"2024-09-21T07:07:57.669620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.963089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663965+0000","last_change":"2024-09-21T07:07:32.551123+0000","last_active":"2024-09-21T07:07:57.663965+0000","last_peered":"2024-09-21T07:07:57.663965+0000","last_clean":"2024-09-21T07:07:57.663965+0000","last_became_active":"2024-09-21T07:07:32.550423+0000","last_became_peered":"2024-09-21T07:07:32.550423+0000","last_unstale":"2024-09-21T07:07:57.663965+0000","last_undegraded":"2024-09-21T07:07:57.663965+0000","last_fullsized":"2024-09-21T07:07:57.663965+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:00.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668428+0000","last_change":"2024-09-21T07:07:30.550102+0000","last_active":"2024-09-21T07:07:57.668428+0000","last_peered":"2024-09-21T07:07:57.668428+0000","last_clean":"2024-09-21T07:07:57.668428+0000","last_became_active":"2024-09-21T07:07:30.549609+0000","last_became_peered":"2024-09-21T07:07:30.549609+0000","last_unstale":"2024-09-21T07:07:57.668428+0000","last_undegraded":"2024-09-21T07:07:57.668428+0000","last_fullsized":"2024-09-21T07:07:57.668428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:58.587612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666452+0000","last_change":"2024-09-21T07:07:32.556167+0000","last_active":"2024-09-21T07:07:57.666452+0000","last_peered":"2024-09-21T07:07:57.666452+0000","last_clean":"2024-09-21T07:07:57.666452+0000","last_became_active":"2024-09-21T07:07:32.555372+0000","last_became_peered":"2024-09-21T07:07:32.555372+0000","last_unstale":"2024-09-21T07:07:57.666452+0000","last_undegraded":"2024-09-21T07:07:57.666452+0000","last_fullsized":"2024-09-21T07:07:57.666452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:35.056919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":53,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:03.666502+0000","last_change":"2024-09-21T07:07:30.543196+0000","last_active":"2024-09-21T07:08:03.666502+0000","last_peered":"2024-09-21T07:08:03.666502+0000","last_clean":"2024-09-21T07:08:03.666502+0000","last_became_active":"2024-09-21T07:07:30.542755+0000","last_became_peered":"2024-09-21T07:07:30.542755+0000","last_unstale":"2024-09-21T07:08:03.666502+0000","last_undegraded":"2024-09-21T07:08:03.666502+0000","last_fullsized":"2024-09-21T07:08:03.666502+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:14.821703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665906+0000","last_change":"2024-09-21T07:07:32.561243+0000","last_active":"2024-09-21T07:07:57.665906+0000","last_peered":"2024-09-21T07:07:57.665906+0000","last_clean":"2024-09-21T07:07:57.665906+0000","last_became_active":"2024-09-21T07:07:32.560878+0000","last_became_peered":"2024-09-21T07:07:32.560878+0000","last_unstale":"2024-09-21T07:07:57.665906+0000","last_undegraded":"2024-09-21T07:07:57.665906+0000","last_fullsized":"2024-09-21T07:07:57.665906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:19.342422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664720+0000","last_change":"2024-09-21T07:07:30.754985+0000","last_active":"2024-09-21T07:07:57.664720+0000","last_peered":"2024-09-21T07:07:57.664720+0000","last_clean":"2024-09-21T07:07:57.664720+0000","last_became_active":"2024-09-21T07:07:30.754490+0000","last_became_peered":"2024-09-21T07:07:30.754490+0000","last_unstale":"2024-09-21T07:07:57.664720+0000","last_undegraded":"2024-09-21T07:07:57.664720+0000","last_fullsized":"2024-09-21T07:07:57.664720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:21.645643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667978+0000","last_change":"2024-09-21T07:07:32.567997+0000","last_active":"2024-09-21T07:07:57.667978+0000","last_peered":"2024-09-21T07:07:57.667978+0000","last_clean":"2024-09-21T07:07:57.667978+0000","last_became_active":"2024-09-21T07:07:32.567314+0000","last_became_peered":"2024-09-21T07:07:32.567314+0000","last_unstale":"2024-09-21T07:07:57.667978+0000","last_undegraded":"2024-09-21T07:07:57.667978+0000","last_fullsized":"2024-09-21T07:07:57.667978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:07.741967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.678889+0000","last_change":"2024-09-21T07:07:57.678175+0000","last_active":"2024-09-21T07:07:57.678889+0000","last_peered":"2024-09-21T07:07:57.678889+0000","last_clean":"2024-09-21T07:07:57.678889+0000","last_became_active":"2024-09-21T07:07:57.671137+0000","last_became_peered":"2024-09-21T07:07:57.671137+0000","last_unstale":"2024-09-21T07:07:57.678889+0000","last_undegraded":"2024-09-21T07:07:57.678889+0000","last_fullsized":"2024-09-21T07:07:57.678889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664423+0000","last_change":"2024-09-21T07:07:32.563380+0000","last_active":"2024-09-21T07:07:57.664423+0000","last_peered":"2024-09-21T07:07:57.664423+0000","last_clean":"2024-09-21T07:07:57.664423+0000","last_became_active":"2024-09-21T07:07:32.563012+0000","last_became_peered":"2024-09-21T07:07:32.563012+0000","last_unstale":"2024-09-21T07:07:57.664423+0000","last_undegraded":"2024-09-21T07:07:57.664423+0000","last_fullsized":"2024-09-21T07:07:57.664423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664634+0000","last_change":"2024-09-21T07:07:30.546448+0000","last_active":"2024-09-21T07:07:57.664634+0000","last_peered":"2024-09-21T07:07:57.664634+0000","last_clean":"2024-09-21T07:07:57.664634+0000","last_became_active":"2024-09-21T07:07:30.546015+0000","last_became_peered":"2024-09-21T07:07:30.546015+0000","last_unstale":"2024-09-21T07:07:57.664634+0000","last_undegraded":"2024-09-21T07:07:57.664634+0000","last_fullsized":"2024-09-21T07:07:57.664634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:23.041651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666630+0000","last_change":"2024-09-21T07:07:32.562533+0000","last_active":"2024-09-21T07:07:57.666630+0000","last_peered":"2024-09-21T07:07:57.666630+0000","last_clean":"2024-09-21T07:07:57.666630+0000","last_became_active":"2024-09-21T07:07:32.562101+0000","last_became_peered":"2024-09-21T07:07:32.562101+0000","last_unstale":"2024-09-21T07:07:57.666630+0000","last_undegraded":"2024-09-21T07:07:57.666630+0000","last_fullsized":"2024-09-21T07:07:57.666630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:49.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668720+0000","last_change":"2024-09-21T07:07:30.547263+0000","last_active":"2024-09-21T07:07:57.668720+0000","last_peered":"2024-09-21T07:07:57.668720+0000","last_clean":"2024-09-21T07:07:57.668720+0000","last_became_active":"2024-09-21T07:07:30.546874+0000","last_became_peered":"2024-09-21T07:07:30.546874+0000","last_unstale":"2024-09-21T07:07:57.668720+0000","last_undegraded":"2024-09-21T07:07:57.668720+0000","last_fullsized":"2024-09-21T07:07:57.668720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:18.545407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666337+0000","last_change":"2024-09-21T07:07:32.560288+0000","last_active":"2024-09-21T07:07:57.666337+0000","last_peered":"2024-09-21T07:07:57.666337+0000","last_clean":"2024-09-21T07:07:57.666337+0000","last_became_active":"2024-09-21T07:07:32.559938+0000","last_became_peered":"2024-09-21T07:07:32.559938+0000","last_unstale":"2024-09-21T07:07:57.666337+0000","last_undegraded":"2024-09-21T07:07:57.666337+0000","last_fullsized":"2024-09-21T07:07:57.666337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:55.531828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:06.670187+0000","last_change":"2024-09-21T07:07:30.754602+0000","last_active":"2024-09-21T07:08:06.670187+0000","last_peered":"2024-09-21T07:08:06.670187+0000","last_clean":"2024-09-21T07:08:06.670187+0000","last_became_active":"2024-09-21T07:07:30.754159+0000","last_became_peered":"2024-09-21T07:07:30.754159+0000","last_unstale":"2024-09-21T07:08:06.670187+0000","last_undegraded":"2024-09-21T07:08:06.670187+0000","last_fullsized":"2024-09-21T07:08:06.670187+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666629+0000","last_change":"2024-09-21T07:07:32.557819+0000","last_active":"2024-09-21T07:07:57.666629+0000","last_peered":"2024-09-21T07:07:57.666629+0000","last_clean":"2024-09-21T07:07:57.666629+0000","last_became_active":"2024-09-21T07:07:32.557363+0000","last_became_peered":"2024-09-21T07:07:32.557363+0000","last_unstale":"2024-09-21T07:07:57.666629+0000","last_undegraded":"2024-09-21T07:07:57.666629+0000","last_fullsized":"2024-09-21T07:07:57.666629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.802658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666087+0000","last_change":"2024-09-21T07:06:20.138629+0000","last_active":"2024-09-21T07:07:57.666087+0000","last_peered":"2024-09-21T07:07:57.666087+0000","last_clean":"2024-09-21T07:07:57.666087+0000","last_became_active":"2024-09-21T07:06:20.132041+0000","last_became_peered":"2024-09-21T07:06:20.132041+0000","last_unstale":"2024-09-21T07:07:57.666087+0000","last_undegraded":"2024-09-21T07:07:57.666087+0000","last_fullsized":"2024-09-21T07:07:57.666087+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_clean_scrub_stamp":"2024-09-21T07:02:52.790893+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:41.784916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668277+0000","last_change":"2024-09-21T07:07:30.541638+0000","last_active":"2024-09-21T07:07:57.668277+0000","last_peered":"2024-09-21T07:07:57.668277+0000","last_clean":"2024-09-21T07:07:57.668277+0000","last_became_active":"2024-09-21T07:07:30.541185+0000","last_became_peered":"2024-09-21T07:07:30.541185+0000","last_unstale":"2024-09-21T07:07:57.668277+0000","last_undegraded":"2024-09-21T07:07:57.668277+0000","last_fullsized":"2024-09-21T07:07:57.668277+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:15.837077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668365+0000","last_change":"2024-09-21T07:07:32.560817+0000","last_active":"2024-09-21T07:07:57.668365+0000","last_peered":"2024-09-21T07:07:57.668365+0000","last_clean":"2024-09-21T07:07:57.668365+0000","last_became_active":"2024-09-21T07:07:32.560269+0000","last_became_peered":"2024-09-21T07:07:32.560269+0000","last_unstale":"2024-09-21T07:07:57.668365+0000","last_undegraded":"2024-09-21T07:07:57.668365+0000","last_fullsized":"2024-09-21T07:07:57.668365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:40.109644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666042+0000","last_change":"2024-09-21T07:07:30.543936+0000","last_active":"2024-09-21T07:07:57.666042+0000","last_peered":"2024-09-21T07:07:57.666042+0000","last_clean":"2024-09-21T07:07:57.666042+0000","last_became_active":"2024-09-21T07:07:30.543530+0000","last_became_peered":"2024-09-21T07:07:30.543530+0000","last_unstale":"2024-09-21T07:07:57.666042+0000","last_undegraded":"2024-09-21T07:07:57.666042+0000","last_fullsized":"2024-09-21T07:07:57.666042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:02.312471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663848+0000","last_change":"2024-09-21T07:07:32.542182+0000","last_active":"2024-09-21T07:07:57.663848+0000","last_peered":"2024-09-21T07:07:57.663848+0000","last_clean":"2024-09-21T07:07:57.663848+0000","last_became_active":"2024-09-21T07:07:32.541750+0000","last_became_peered":"2024-09-21T07:07:32.541750+0000","last_unstale":"2024-09-21T07:07:57.663848+0000","last_undegraded":"2024-09-21T07:07:57.663848+0000","last_fullsized":"2024-09-21T07:07:57.663848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.184712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:04.667354+0000","last_change":"2024-09-21T07:07:30.754978+0000","last_active":"2024-09-21T07:08:04.667354+0000","last_peered":"2024-09-21T07:08:04.667354+0000","last_clean":"2024-09-21T07:08:04.667354+0000","last_became_active":"2024-09-21T07:07:30.754149+0000","last_became_peered":"2024-09-21T07:07:30.754149+0000","last_unstale":"2024-09-21T07:08:04.667354+0000","last_undegraded":"2024-09-21T07:08:04.667354+0000","last_fullsized":"2024-09-21T07:08:04.667354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:36.140237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668604+0000","last_change":"2024-09-21T07:07:32.570424+0000","last_active":"2024-09-21T07:07:57.668604+0000","last_peered":"2024-09-21T07:07:57.668604+0000","last_clean":"2024-09-21T07:07:57.668604+0000","last_became_active":"2024-09-21T07:07:32.570029+0000","last_became_peered":"2024-09-21T07:07:32.570029+0000","last_unstale":"2024-09-21T07:07:57.668604+0000","last_undegraded":"2024-09-21T07:07:57.668604+0000","last_fullsized":"2024-09-21T07:07:57.668604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:09.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":53,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:04.666761+0000","last_change":"2024-09-21T07:07:30.543963+0000","last_active":"2024-09-21T07:08:04.666761+0000","last_peered":"2024-09-21T07:08:04.666761+0000","last_clean":"2024-09-21T07:08:04.666761+0000","last_became_active":"2024-09-21T07:07:30.543586+0000","last_became_peered":"2024-09-21T07:07:30.543586+0000","last_unstale":"2024-09-21T07:08:04.666761+0000","last_undegraded":"2024-09-21T07:08:04.666761+0000","last_fullsized":"2024-09-21T07:08:04.666761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:05.782005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662307+0000","last_change":"2024-09-21T07:07:32.556132+0000","last_active":"2024-09-21T07:07:57.662307+0000","last_peered":"2024-09-21T07:07:57.662307+0000","last_clean":"2024-09-21T07:07:57.662307+0000","last_became_active":"2024-09-21T07:07:32.555717+0000","last_became_peered":"2024-09-21T07:07:32.555717+0000","last_unstale":"2024-09-21T07:07:57.662307+0000","last_undegraded":"2024-09-21T07:07:57.662307+0000","last_fullsized":"2024-09-21T07:07:57.662307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.809268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661088+0000","last_change":"2024-09-21T07:07:30.755143+0000","last_active":"2024-09-21T07:07:57.661088+0000","last_peered":"2024-09-21T07:07:57.661088+0000","last_clean":"2024-09-21T07:07:57.661088+0000","last_became_active":"2024-09-21T07:07:30.754591+0000","last_became_peered":"2024-09-21T07:07:30.754591+0000","last_unstale":"2024-09-21T07:07:57.661088+0000","last_undegraded":"2024-09-21T07:07:57.661088+0000","last_fullsized":"2024-09-21T07:07:57.661088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:13.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662201+0000","last_change":"2024-09-21T07:07:32.552869+0000","last_active":"2024-09-21T07:07:57.662201+0000","last_peered":"2024-09-21T07:07:57.662201+0000","last_clean":"2024-09-21T07:07:57.662201+0000","last_became_active":"2024-09-21T07:07:32.552483+0000","last_became_peered":"2024-09-21T07:07:32.552483+0000","last_unstale":"2024-09-21T07:07:57.662201+0000","last_undegraded":"2024-09-21T07:07:57.662201+0000","last_fullsized":"2024-09-21T07:07:57.662201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:21.006847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665762+0000","last_change":"2024-09-21T07:07:30.755552+0000","last_active":"2024-09-21T07:07:57.665762+0000","last_peered":"2024-09-21T07:07:57.665762+0000","last_clean":"2024-09-21T07:07:57.665762+0000","last_became_active":"2024-09-21T07:07:30.754451+0000","last_became_peered":"2024-09-21T07:07:30.754451+0000","last_unstale":"2024-09-21T07:07:57.665762+0000","last_undegraded":"2024-09-21T07:07:57.665762+0000","last_fullsized":"2024-09-21T07:07:57.665762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:50.229649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664284+0000","last_change":"2024-09-21T07:07:32.543249+0000","last_active":"2024-09-21T07:07:57.664284+0000","last_peered":"2024-09-21T07:07:57.664284+0000","last_clean":"2024-09-21T07:07:57.664284+0000","last_became_active":"2024-09-21T07:07:32.542866+0000","last_became_peered":"2024-09-21T07:07:32.542866+0000","last_unstale":"2024-09-21T07:07:57.664284+0000","last_undegraded":"2024-09-21T07:07:57.664284+0000","last_fullsized":"2024-09-21T07:07:57.664284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:29.476454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661340+0000","last_change":"2024-09-21T07:07:30.541589+0000","last_active":"2024-09-21T07:07:57.661340+0000","last_peered":"2024-09-21T07:07:57.661340+0000","last_clean":"2024-09-21T07:07:57.661340+0000","last_became_active":"2024-09-21T07:07:30.541171+0000","last_became_peered":"2024-09-21T07:07:30.541171+0000","last_unstale":"2024-09-21T07:07:57.661340+0000","last_undegraded":"2024-09-21T07:07:57.661340+0000","last_fullsized":"2024-09-21T07:07:57.661340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:46.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668335+0000","last_change":"2024-09-21T07:07:32.558409+0000","last_active":"2024-09-21T07:07:57.668335+0000","last_peered":"2024-09-21T07:07:57.668335+0000","last_clean":"2024-09-21T07:07:57.668335+0000","last_became_active":"2024-09-21T07:07:32.557886+0000","last_became_peered":"2024-09-21T07:07:32.557886+0000","last_unstale":"2024-09-21T07:07:57.668335+0000","last_undegraded":"2024-09-21T07:07:57.668335+0000","last_fullsized":"2024-09-21T07:07:57.668335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.071651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668890+0000","last_change":"2024-09-21T07:07:30.536107+0000","last_active":"2024-09-21T07:07:57.668890+0000","last_peered":"2024-09-21T07:07:57.668890+0000","last_clean":"2024-09-21T07:07:57.668890+0000","last_became_active":"2024-09-21T07:07:30.535455+0000","last_became_peered":"2024-09-21T07:07:30.535455+0000","last_unstale":"2024-09-21T07:07:57.668890+0000","last_undegraded":"2024-09-21T07:07:57.668890+0000","last_fullsized":"2024-09-21T07:07:57.668890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:55.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700974+0000","last_change":"2024-09-21T07:07:32.553187+0000","last_active":"2024-09-21T07:07:57.700974+0000","last_peered":"2024-09-21T07:07:57.700974+0000","last_clean":"2024-09-21T07:07:57.700974+0000","last_became_active":"2024-09-21T07:07:32.552905+0000","last_became_peered":"2024-09-21T07:07:32.552905+0000","last_unstale":"2024-09-21T07:07:57.700974+0000","last_undegraded":"2024-09-21T07:07:57.700974+0000","last_fullsized":"2024-09-21T07:07:57.700974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:24.790329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670080+0000","last_change":"2024-09-21T07:07:30.754858+0000","last_active":"2024-09-21T07:07:57.670080+0000","last_peered":"2024-09-21T07:07:57.670080+0000","last_clean":"2024-09-21T07:07:57.670080+0000","last_became_active":"2024-09-21T07:07:30.754483+0000","last_became_peered":"2024-09-21T07:07:30.754483+0000","last_unstale":"2024-09-21T07:07:57.670080+0000","last_undegraded":"2024-09-21T07:07:57.670080+0000","last_fullsized":"2024-09-21T07:07:57.670080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:29.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664984+0000","last_change":"2024-09-21T07:07:32.562213+0000","last_active":"2024-09-21T07:07:57.664984+0000","last_peered":"2024-09-21T07:07:57.664984+0000","last_clean":"2024-09-21T07:07:57.664984+0000","last_became_active":"2024-09-21T07:07:32.561834+0000","last_became_peered":"2024-09-21T07:07:32.561834+0000","last_unstale":"2024-09-21T07:07:57.664984+0000","last_undegraded":"2024-09-21T07:07:57.664984+0000","last_fullsized":"2024-09-21T07:07:57.664984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:12.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668009+0000","last_change":"2024-09-21T07:07:30.543455+0000","last_active":"2024-09-21T07:07:57.668009+0000","last_peered":"2024-09-21T07:07:57.668009+0000","last_clean":"2024-09-21T07:07:57.668009+0000","last_became_active":"2024-09-21T07:07:30.543059+0000","last_became_peered":"2024-09-21T07:07:30.543059+0000","last_unstale":"2024-09-21T07:07:57.668009+0000","last_undegraded":"2024-09-21T07:07:57.668009+0000","last_fullsized":"2024-09-21T07:07:57.668009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.896121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664245+0000","last_change":"2024-09-21T07:07:32.560600+0000","last_active":"2024-09-21T07:07:57.664245+0000","last_peered":"2024-09-21T07:07:57.664245+0000","last_clean":"2024-09-21T07:07:57.664245+0000","last_became_active":"2024-09-21T07:07:32.560159+0000","last_became_peered":"2024-09-21T07:07:32.560159+0000","last_unstale":"2024-09-21T07:07:57.664245+0000","last_undegraded":"2024-09-21T07:07:57.664245+0000","last_fullsized":"2024-09-21T07:07:57.664245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.228180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.683341+0000","last_change":"2024-09-21T07:07:57.682685+0000","last_active":"2024-09-21T07:07:57.683341+0000","last_peered":"2024-09-21T07:07:57.683341+0000","last_clean":"2024-09-21T07:07:57.683341+0000","last_became_active":"2024-09-21T07:07:57.671259+0000","last_became_peered":"2024-09-21T07:07:57.671259+0000","last_unstale":"2024-09-21T07:07:57.683341+0000","last_undegraded":"2024-09-21T07:07:57.683341+0000","last_fullsized":"2024-09-21T07:07:57.683341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668076+0000","last_change":"2024-09-21T07:07:32.554033+0000","last_active":"2024-09-21T07:07:57.668076+0000","last_peered":"2024-09-21T07:07:57.668076+0000","last_clean":"2024-09-21T07:07:57.668076+0000","last_became_active":"2024-09-21T07:07:32.553654+0000","last_became_peered":"2024-09-21T07:07:32.553654+0000","last_unstale":"2024-09-21T07:07:57.668076+0000","last_undegraded":"2024-09-21T07:07:57.668076+0000","last_fullsized":"2024-09-21T07:07:57.668076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:15.876104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665390+0000","last_change":"2024-09-21T07:07:30.547818+0000","last_active":"2024-09-21T07:07:57.665390+0000","last_peered":"2024-09-21T07:07:57.665390+0000","last_clean":"2024-09-21T07:07:57.665390+0000","last_became_active":"2024-09-21T07:07:30.547387+0000","last_became_peered":"2024-09-21T07:07:30.547387+0000","last_unstale":"2024-09-21T07:07:57.665390+0000","last_undegraded":"2024-09-21T07:07:57.665390+0000","last_fullsized":"2024-09-21T07:07:57.665390+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666216+0000","last_change":"2024-09-21T07:07:32.566731+0000","last_active":"2024-09-21T07:07:57.666216+0000","last_peered":"2024-09-21T07:07:57.666216+0000","last_clean":"2024-09-21T07:07:57.666216+0000","last_became_active":"2024-09-21T07:07:32.566233+0000","last_became_peered":"2024-09-21T07:07:32.566233+0000","last_unstale":"2024-09-21T07:07:57.666216+0000","last_undegraded":"2024-09-21T07:07:57.666216+0000","last_fullsized":"2024-09-21T07:07:57.666216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:57.630088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.673727+0000","last_change":"2024-09-21T07:07:57.673550+0000","last_active":"2024-09-21T07:07:57.673727+0000","last_peered":"2024-09-21T07:07:57.673727+0000","last_clean":"2024-09-21T07:07:57.673727+0000","last_became_active":"2024-09-21T07:07:57.673036+0000","last_became_peered":"2024-09-21T07:07:57.673036+0000","last_unstale":"2024-09-21T07:07:57.673727+0000","last_undegraded":"2024-09-21T07:07:57.673727+0000","last_fullsized":"2024-09-21T07:07:57.673727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:53.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665716+0000","last_change":"2024-09-21T07:07:30.544884+0000","last_active":"2024-09-21T07:07:57.665716+0000","last_peered":"2024-09-21T07:07:57.665716+0000","last_clean":"2024-09-21T07:07:57.665716+0000","last_became_active":"2024-09-21T07:07:30.543321+0000","last_became_peered":"2024-09-21T07:07:30.543321+0000","last_unstale":"2024-09-21T07:07:57.665716+0000","last_undegraded":"2024-09-21T07:07:57.665716+0000","last_fullsized":"2024-09-21T07:07:57.665716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.234905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670015+0000","last_change":"2024-09-21T07:07:32.566124+0000","last_active":"2024-09-21T07:07:57.670015+0000","last_peered":"2024-09-21T07:07:57.670015+0000","last_clean":"2024-09-21T07:07:57.670015+0000","last_became_active":"2024-09-21T07:07:32.565743+0000","last_became_peered":"2024-09-21T07:07:32.565743+0000","last_unstale":"2024-09-21T07:07:57.670015+0000","last_undegraded":"2024-09-21T07:07:57.670015+0000","last_fullsized":"2024-09-21T07:07:57.670015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:57.048529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665685+0000","last_change":"2024-09-21T07:07:30.546742+0000","last_active":"2024-09-21T07:07:57.665685+0000","last_peered":"2024-09-21T07:07:57.665685+0000","last_clean":"2024-09-21T07:07:57.665685+0000","last_became_active":"2024-09-21T07:07:30.546300+0000","last_became_peered":"2024-09-21T07:07:30.546300+0000","last_unstale":"2024-09-21T07:07:57.665685+0000","last_undegraded":"2024-09-21T07:07:57.665685+0000","last_fullsized":"2024-09-21T07:07:57.665685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:58.903582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701061+0000","last_change":"2024-09-21T07:07:32.565602+0000","last_active":"2024-09-21T07:07:57.701061+0000","last_peered":"2024-09-21T07:07:57.701061+0000","last_clean":"2024-09-21T07:07:57.701061+0000","last_became_active":"2024-09-21T07:07:32.565252+0000","last_became_peered":"2024-09-21T07:07:32.565252+0000","last_unstale":"2024-09-21T07:07:57.701061+0000","last_undegraded":"2024-09-21T07:07:57.701061+0000","last_fullsized":"2024-09-21T07:07:57.701061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:50.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668572+0000","last_change":"2024-09-21T07:07:30.754535+0000","last_active":"2024-09-21T07:07:57.668572+0000","last_peered":"2024-09-21T07:07:57.668572+0000","last_clean":"2024-09-21T07:07:57.668572+0000","last_became_active":"2024-09-21T07:07:30.754129+0000","last_became_peered":"2024-09-21T07:07:30.754129+0000","last_unstale":"2024-09-21T07:07:57.668572+0000","last_undegraded":"2024-09-21T07:07:57.668572+0000","last_fullsized":"2024-09-21T07:07:57.668572+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:23.800713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668229+0000","last_change":"2024-09-21T07:07:32.561210+0000","last_active":"2024-09-21T07:07:57.668229+0000","last_peered":"2024-09-21T07:07:57.668229+0000","last_clean":"2024-09-21T07:07:57.668229+0000","last_became_active":"2024-09-21T07:07:32.560850+0000","last_became_peered":"2024-09-21T07:07:32.560850+0000","last_unstale":"2024-09-21T07:07:57.668229+0000","last_undegraded":"2024-09-21T07:07:57.668229+0000","last_fullsized":"2024-09-21T07:07:57.668229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.212097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":60,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:05.667409+0000","last_change":"2024-09-21T07:07:30.543778+0000","last_active":"2024-09-21T07:08:05.667409+0000","last_peered":"2024-09-21T07:08:05.667409+0000","last_clean":"2024-09-21T07:08:05.667409+0000","last_became_active":"2024-09-21T07:07:30.543474+0000","last_became_peered":"2024-09-21T07:07:30.543474+0000","last_unstale":"2024-09-21T07:08:05.667409+0000","last_undegraded":"2024-09-21T07:08:05.667409+0000","last_fullsized":"2024-09-21T07:08:05.667409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:06.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72352,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":275,"num_read_kb":218,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":217056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":395386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972377,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40992,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704160,"statfs":{"total":95995035648,"available":95953059840,"internally_reserved":0,"allocated":1523712,"data_stored":1051150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135901,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":394903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332131,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":395259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528360,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1437696,"data_stored":988190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691885,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":395011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888114,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1449984,"data_stored":987086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":394872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215164,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":394445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":460901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":460681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40340,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704812,"statfs":{"total":95995035648,"available":95953727488,"internally_reserved":0,"allocated":847872,"data_stored":396350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:08:11.198 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:08:11.199 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T07:08:11.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T07:08:11.459 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:11 smithi029 ceph-mon[30983]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1022 B/s wr, 10 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T07:08:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:11 smithi029 ceph-mon[30983]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:11.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 -- 172.21.15.29:0/3199443781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd0109470 msgr2=0x7fcdd010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:11.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/3199443781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd0109470 0x7fcdd010b980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009ca0 tx=0x7fcdc002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:11.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 -- 172.21.15.29:0/3199443781 shutdown_connections 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/3199443781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd0109470 0x7fcdd010b980 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/3199443781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdd0106930 0x7fcdd0108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/3199443781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdd006b920 0x7fcdd01063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 -- 172.21.15.29:0/3199443781 >> 172.21.15.29:0/3199443781 conn(0x7fcdd00fdfb0 msgr2=0x7fcdd0100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 -- 172.21.15.29:0/3199443781 shutdown_connections 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.921+0000 7fcdd82a5640 1 -- 172.21.15.29:0/3199443781 wait complete. 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 Processor -- start 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 -- start start 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd006b920 0x7fcdd0199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdd0106930 0x7fcdd019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdd0109470 0x7fcdd019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd010f380 con 0x7fcdd006b920 2024-09-21T07:08:11.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd010f200 con 0x7fcdd0109470 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd82a5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd010f500 con 0x7fcdd0106930 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd006b920 0x7fcdd0199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd006b920 0x7fcdd0199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45498/0 (socket says 172.21.15.29:45498) 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 -- 172.21.15.29:0/4171611013 learned_addr learned my addr 172.21.15.29:0/4171611013 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd5840640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdd0106930 0x7fcdd019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6842640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdd0109470 0x7fcdd019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 -- 172.21.15.29:0/4171611013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdd0106930 msgr2=0x7fcdd019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdd0106930 0x7fcdd019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 -- 172.21.15.29:0/4171611013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdd0109470 msgr2=0x7fcdd019b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdd0109470 0x7fcdd019b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6041640 1 -- 172.21.15.29:0/4171611013 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd019b980 con 0x7fcdd006b920 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.922+0000 7fcdd6842640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdd0109470 0x7fcdd019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.923+0000 7fcdd6041640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd006b920 0x7fcdd0199f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800d950 tx=0x7fcdc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:11.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.923+0000 7fcdcf7fe640 1 -- 172.21.15.29:0/4171611013 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8017030 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.923+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd019bc70 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.923+0000 7fcdcf7fe640 1 -- 172.21.15.29:0/4171611013 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc8004020 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.923+0000 7fcdcf7fe640 1 -- 172.21.15.29:0/4171611013 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80047a0 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.923+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd01a2370 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.924+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd00ffad0 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.925+0000 7fcdcf7fe640 1 -- 172.21.15.29:0/4171611013 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcdc8009a30 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.926+0000 7fcdcf7fe640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fcdb80b65a0 0x7fcdb80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.926+0000 7fcdd5840640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fcdb80b65a0 0x7fcdb80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.926+0000 7fcdcf7fe640 1 -- 172.21.15.29:0/4171611013 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fcdc80e75b0 con 0x7fcdd006b920 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.927+0000 7fcdd5840640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fcdb80b65a0 0x7fcdb80b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009b50 tx=0x7fcdc4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:11.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:11.929+0000 7fcdcf7fe640 1 -- 172.21.15.29:0/4171611013 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdc80adcf0 con 0x7fcdd006b920 2024-09-21T07:08:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:11 smithi052 ceph-mon[34308]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1022 B/s wr, 10 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T07:08:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:11 smithi052 ceph-mon[34308]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:12.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:11 smithi066 ceph-mon[34793]: pgmap v312: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1022 B/s wr, 10 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T07:08:12.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:11 smithi066 ceph-mon[34793]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.191+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fcdd002e640 con 0x7fcdd006b920 2024-09-21T07:08:12.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.194+0000 7fcdcf7fe640 1 -- 172.21.15.29:0/4171611013 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fcdc80b20d0 con 0x7fcdd006b920 2024-09-21T07:08:12.196 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-09-21T07:08:12.196 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDccO5mPQV4CxAA4o7wNGx1DoPGsnosyoHr2g== 2024-09-21T07:08:12.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fcdb80b65a0 msgr2=0x7fcdb80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:12.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fcdb80b65a0 0x7fcdb80b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009b50 tx=0x7fcdc4005f90 comp rx=0 tx=0).stop 2024-09-21T07:08:12.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd006b920 msgr2=0x7fcdd0199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:12.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd006b920 0x7fcdd0199f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800d950 tx=0x7fcdc800de10 comp rx=0 tx=0).stop 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 shutdown_connections 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fcdb80b65a0 0x7fcdb80b8ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcdd0109470 0x7fcdd019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcdd0106930 0x7fcdd019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 --2- 172.21.15.29:0/4171611013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcdd006b920 0x7fcdd0199f50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 >> 172.21.15.29:0/4171611013 conn(0x7fcdd00fdfb0 msgr2=0x7fcdd0104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.196+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 shutdown_connections 2024-09-21T07:08:12.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:12.197+0000 7fcdd82a5640 1 -- 172.21.15.29:0/4171611013 wait complete. 2024-09-21T07:08:12.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:12 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4171611013' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:08:12.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:12 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4171611013' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:08:12.969 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:08:12.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T07:08:12.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T07:08:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:12 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4171611013' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:08:12.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:12 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4171611013' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:08:13.007 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T07:08:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:12 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4171611013' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T07:08:13.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:12 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4171611013' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T07:08:13.303 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 -- 172.21.15.29:0/3213125621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4398103b60 msgr2=0x7f4398103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 --2- 172.21.15.29:0/3213125621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4398103b60 0x7f4398103f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4394009900 tx=0x7f439402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 -- 172.21.15.29:0/3213125621 shutdown_connections 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 --2- 172.21.15.29:0/3213125621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4398109df0 0x7f4398110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 --2- 172.21.15.29:0/3213125621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43981094a0 0x7f43981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 --2- 172.21.15.29:0/3213125621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4398103b60 0x7f4398103f70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 -- 172.21.15.29:0/3213125621 >> 172.21.15.29:0/3213125621 conn(0x7f439807b850 msgr2=0x7f439807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 -- 172.21.15.29:0/3213125621 shutdown_connections 2024-09-21T07:08:13.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.800+0000 7f43a07c1640 1 -- 172.21.15.29:0/3213125621 wait complete. 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 Processor -- start 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 -- start start 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4398103b60 0x7f439819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43981094a0 0x7f439819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4398109df0 0x7f439819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4398113b70 con 0x7f43981094a0 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43981139f0 con 0x7f4398103b60 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.801+0000 7f43a07c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4398113cf0 con 0x7f4398109df0 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43981094a0 0x7f439819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43981094a0 0x7f439819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45504/0 (socket says 172.21.15.29:45504) 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 -- 172.21.15.29:0/2333026095 learned_addr learned my addr 172.21.15.29:0/2333026095 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:13.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439e55d640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4398103b60 0x7f439819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439ed5e640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4398109df0 0x7f439819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 -- 172.21.15.29:0/2333026095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4398109df0 msgr2=0x7f439819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4398109df0 0x7f439819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 -- 172.21.15.29:0/2333026095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4398103b60 msgr2=0x7f439819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4398103b60 0x7f439819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 -- 172.21.15.29:0/2333026095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43981a05b0 con 0x7f43981094a0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f439dd5c640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43981094a0 0x7f439819abe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4388006fd0 tx=0x7f438800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f438f7fe640 1 -- 172.21.15.29:0/2333026095 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388011830 con 0x7f43981094a0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f438f7fe640 1 -- 172.21.15.29:0/2333026095 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4388016070 con 0x7f43981094a0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43981a08a0 con 0x7f43981094a0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f438f7fe640 1 -- 172.21.15.29:0/2333026095 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388010e00 con 0x7f43981094a0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.802+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43981a7000 con 0x7f43981094a0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.804+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4398103ff0 con 0x7f43981094a0 2024-09-21T07:08:13.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.805+0000 7f438f7fe640 1 -- 172.21.15.29:0/2333026095 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f43880119d0 con 0x7f43981094a0 2024-09-21T07:08:13.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.806+0000 7f438f7fe640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f43840b65a0 0x7f43840b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:13.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.806+0000 7f439e55d640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f43840b65a0 0x7f43840b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:13.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.806+0000 7f438f7fe640 1 -- 172.21.15.29:0/2333026095 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f43880e70f0 con 0x7f43981094a0 2024-09-21T07:08:13.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.807+0000 7f439e55d640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f43840b65a0 0x7f43840b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4394031440 tx=0x7f4394005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:13.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.809+0000 7f438f7fe640 1 -- 172.21.15.29:0/2333026095 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43880ad7d0 con 0x7f43981094a0 2024-09-21T07:08:13.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:13 smithi052 ceph-mon[34308]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T07:08:13.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.998+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f439819b770 con 0x7f43981094a0 2024-09-21T07:08:13.999 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:13 smithi029 ceph-mon[30983]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T07:08:14.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:13.998+0000 7f438f7fe640 1 -- 172.21.15.29:0/2333026095 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v51) ==== 86+0+133 (secure 0 0 0) 0x7f439819b770 con 0x7f43981094a0 2024-09-21T07:08:14.000 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f43840b65a0 msgr2=0x7f43840b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:14.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f43840b65a0 0x7f43840b8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4394031440 tx=0x7f4394005e80 comp rx=0 tx=0).stop 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43981094a0 msgr2=0x7f439819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43981094a0 0x7f439819abe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4388006fd0 tx=0x7f438800b8e0 comp rx=0 tx=0).stop 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 shutdown_connections 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f43840b65a0 0x7f43840b8ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4398109df0 0x7f439819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43981094a0 0x7f439819abe0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.000+0000 7f43a07c1640 1 --2- 172.21.15.29:0/2333026095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4398103b60 0x7f439819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.001+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 >> 172.21.15.29:0/2333026095 conn(0x7f439807b850 msgr2=0x7f43981076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.001+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 shutdown_connections 2024-09-21T07:08:14.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:14.001+0000 7f43a07c1640 1 -- 172.21.15.29:0/2333026095 wait complete. 2024-09-21T07:08:14.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:13 smithi066 ceph-mon[34793]: pgmap v313: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T07:08:14.792 INFO:teuthology.orchestra.run.smithi029.stdout:[{"version":51,"timestamp":"2024-09-21T07:07:23.985369+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T07:08:14.793 INFO:tasks.ceph_manager:config epoch is 51 2024-09-21T07:08:14.793 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:08:14.793 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:08:14.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T07:08:14.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:14 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2333026095' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:08:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:15.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:14 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2333026095' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:08:15.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:14 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2333026095' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 -- 172.21.15.29:0/416602144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 msgr2=0x7f264010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 --2- 172.21.15.29:0/416602144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264010d8d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2634009900 tx=0x7f263402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 -- 172.21.15.29:0/416602144 shutdown_connections 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 --2- 172.21.15.29:0/416602144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f264010de60 0x7f2640110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 --2- 172.21.15.29:0/416602144 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264010d8d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 --2- 172.21.15.29:0/416602144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2640104a30 0x7f2640104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 -- 172.21.15.29:0/416602144 >> 172.21.15.29:0/416602144 conn(0x7f2640079760 msgr2=0x7f2640079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 -- 172.21.15.29:0/416602144 shutdown_connections 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.525+0000 7f26471be640 1 -- 172.21.15.29:0/416602144 wait complete. 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 Processor -- start 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 -- start start 2024-09-21T07:08:15.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640104a30 0x7f264019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f264010de60 0x7f264019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2640113aa0 con 0x7f2640105380 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2640113920 con 0x7f264010de60 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f26471be640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2640113c20 con 0x7f2640104a30 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f263ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f263ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45524/0 (socket says 172.21.15.29:45524) 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f263ffff640 1 -- 172.21.15.29:0/4080488207 learned_addr learned my addr 172.21.15.29:0/4080488207 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.526+0000 7f2644f5a640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640104a30 0x7f264019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f264575b640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f264010de60 0x7f264019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263ffff640 1 -- 172.21.15.29:0/4080488207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640104a30 msgr2=0x7f264019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263ffff640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640104a30 0x7f264019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263ffff640 1 -- 172.21.15.29:0/4080488207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f264010de60 msgr2=0x7f264019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263ffff640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f264010de60 0x7f264019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263ffff640 1 -- 172.21.15.29:0/4080488207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26401a0420 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263ffff640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264019aa50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f263402a930 tx=0x7f2634004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263dffb640 1 -- 172.21.15.29:0/4080488207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263403f030 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263dffb640 1 -- 172.21.15.29:0/4080488207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2634003aa0 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26401a06b0 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f263dffb640 1 -- 172.21.15.29:0/4080488207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634035070 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.527+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26401a6e70 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.528+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264006c1f0 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.530+0000 7f263dffb640 1 -- 172.21.15.29:0/4080488207 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2634042030 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.531+0000 7f263dffb640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26280b6620 0x7f26280b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.531+0000 7f2644f5a640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26280b6620 0x7f26280b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.531+0000 7f263dffb640 1 -- 172.21.15.29:0/4080488207 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2634107f70 con 0x7f2640105380 2024-09-21T07:08:15.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.531+0000 7f2644f5a640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26280b6620 0x7f26280b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f264006c8f0 tx=0x7f263000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:15.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.534+0000 7f263dffb640 1 -- 172.21.15.29:0/4080488207 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26340ce650 con 0x7f2640105380 2024-09-21T07:08:15.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.776+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2640104e40 con 0x7f2640105380 2024-09-21T07:08:15.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.781+0000 7f263dffb640 1 -- 172.21.15.29:0/4080488207 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296436 (secure 0 0 0) 0x7f26340d2a30 con 0x7f2640105380 2024-09-21T07:08:15.786 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26280b6620 msgr2=0x7f26280b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26280b6620 0x7f26280b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f264006c8f0 tx=0x7f263000b390 comp rx=0 tx=0).stop 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 msgr2=0x7f264019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264019aa50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f263402a930 tx=0x7f2634004270 comp rx=0 tx=0).stop 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 shutdown_connections 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26280b6620 0x7f26280b8b30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f264010de60 0x7f264019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2640105380 0x7f264019aa50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 --2- 172.21.15.29:0/4080488207 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2640104a30 0x7f264019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 >> 172.21.15.29:0/4080488207 conn(0x7f2640079760 msgr2=0x7f26401008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:15.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 shutdown_connections 2024-09-21T07:08:15.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:15.784+0000 7f26471be640 1 -- 172.21.15.29:0/4080488207 wait complete. 2024-09-21T07:08:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:15 smithi052 ceph-mon[34308]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:08:16.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:15 smithi066 ceph-mon[34793]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:08:16.110 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:15 smithi029 ceph-mon[30983]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-21T07:08:16.620 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":4201921978},{"type":"v1","addr":"172.21.15.29:6801","nonce":4201921978}]},"active_addr":"172.21.15.29:6801/4201921978","active_change":"2024-09-21T06:59:55.886638+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24127,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24137,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.29:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":506368439}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":923900830}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":3588213703}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":2475348155}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":4188940411}]}]} 2024-09-21T07:08:16.626 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T07:08:16.626 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T07:08:16.626 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:08:16.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:16 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4080488207' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:08:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:16.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:16 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4080488207' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:08:17.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:16 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4080488207' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T07:08:17.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 -- 172.21.15.29:0/1642256940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd81094b0 msgr2=0x7f7cd81098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:17.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 --2- 172.21.15.29:0/1642256940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd81094b0 0x7f7cd81098c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009900 tx=0x7f7ccc02a410 comp rx=0 tx=0).stop 2024-09-21T07:08:17.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 -- 172.21.15.29:0/1642256940 shutdown_connections 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 --2- 172.21.15.29:0/1642256940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd8109e00 0x7f7cd8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 --2- 172.21.15.29:0/1642256940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd81094b0 0x7f7cd81098c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 --2- 172.21.15.29:0/1642256940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cd8103bc0 0x7f7cd8103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 -- 172.21.15.29:0/1642256940 >> 172.21.15.29:0/1642256940 conn(0x7f7cd807b910 msgr2=0x7f7cd807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 -- 172.21.15.29:0/1642256940 shutdown_connections 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.420+0000 7f7cde27c640 1 -- 172.21.15.29:0/1642256940 wait complete. 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.421+0000 7f7cde27c640 1 Processor -- start 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.421+0000 7f7cde27c640 1 -- start start 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cde27c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd8103bc0 0x7f7cd819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cde27c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd81094b0 0x7f7cd819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cde27c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cd8109e00 0x7f7cd819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cde27c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd8113ac0 con 0x7f7cd8103bc0 2024-09-21T07:08:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cde27c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd8113940 con 0x7f7cd8109e00 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cde27c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd8113c40 con 0x7f7cd81094b0 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd8103bc0 0x7f7cd819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd8103bc0 0x7f7cd819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58748/0 (socket says 172.21.15.29:58748) 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 -- 172.21.15.29:0/3644827026 learned_addr learned my addr 172.21.15.29:0/3644827026 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cdc819640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cd8109e00 0x7f7cd819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd77fe640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd81094b0 0x7f7cd819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 -- 172.21.15.29:0/3644827026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd81094b0 msgr2=0x7f7cd819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd81094b0 0x7f7cd819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 -- 172.21.15.29:0/3644827026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cd8109e00 msgr2=0x7f7cd819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cd8109e00 0x7f7cd819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 -- 172.21.15.29:0/3644827026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd81a0440 con 0x7f7cd8103bc0 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cdc819640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cd8109e00 0x7f7cd819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.422+0000 7f7cd7fff640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd8103bc0 0x7f7cd819a4d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800d950 tx=0x7f7cc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.423+0000 7f7cd57fa640 1 -- 172.21.15.29:0/3644827026 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8017070 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.423+0000 7f7cd57fa640 1 -- 172.21.15.29:0/3644827026 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cc8009c30 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.423+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd81a0730 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.423+0000 7f7cd57fa640 1 -- 172.21.15.29:0/3644827026 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800f620 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.423+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd81a6e90 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.424+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd8103fd0 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.425+0000 7f7cd57fa640 1 -- 172.21.15.29:0/3644827026 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7cc8005030 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.426+0000 7f7cd57fa640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7cc00b65a0 0x7f7cc00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.426+0000 7f7cd77fe640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7cc00b65a0 0x7f7cc00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.426+0000 7f7cd57fa640 1 -- 172.21.15.29:0/3644827026 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7cc80e7130 con 0x7f7cd8103bc0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.427+0000 7f7cd77fe640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7cc00b65a0 0x7f7cc00b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc006010 tx=0x7f7ccc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.429+0000 7f7cd57fa640 1 -- 172.21.15.29:0/3644827026 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7cc80ad870 con 0x7f7cd8103bc0 2024-09-21T07:08:17.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.618+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cd810b660 con 0x7f7cd8103bc0 2024-09-21T07:08:17.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.620+0000 7f7cd57fa640 1 -- 172.21.15.29:0/3644827026 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22640 (secure 0 0 0) 0x7f7cc8009de0 con 0x7f7cd8103bc0 2024-09-21T07:08:17.622 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:17.622 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":75,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:57.657853+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:08:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7cc00b65a0 msgr2=0x7f7cc00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7cc00b65a0 0x7f7cc00b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc006010 tx=0x7f7ccc000bc0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd8103bc0 msgr2=0x7f7cd819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd8103bc0 0x7f7cd819a4d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800d950 tx=0x7f7cc800de10 comp rx=0 tx=0).stop 2024-09-21T07:08:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 shutdown_connections 2024-09-21T07:08:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7cc00b65a0 0x7f7cc00b8ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cd8109e00 0x7f7cd819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cd81094b0 0x7f7cd819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 --2- 172.21.15.29:0/3644827026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cd8103bc0 0x7f7cd819a4d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 >> 172.21.15.29:0/3644827026 conn(0x7f7cd807b910 msgr2=0x7f7cd81075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 shutdown_connections 2024-09-21T07:08:17.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:17.623+0000 7f7cde27c640 1 -- 172.21.15.29:0/3644827026 wait complete. 2024-09-21T07:08:17.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:17 smithi029 ceph-mon[30983]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:08:17.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:17 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3644827026' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:17 smithi052 ceph-mon[34308]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:08:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:17 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3644827026' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:17 smithi066 ceph-mon[34793]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-21T07:08:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:17 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3644827026' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:18.451 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T07:08:18.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:08:18.716 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 -- 172.21.15.29:0/819771455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 msgr2=0x7f112810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 --2- 172.21.15.29:0/819771455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112810d8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1110009900 tx=0x7f111002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 -- 172.21.15.29:0/819771455 shutdown_connections 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 --2- 172.21.15.29:0/819771455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112810ddf0 0x7f1128110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 --2- 172.21.15.29:0/819771455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112810d8b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 --2- 172.21.15.29:0/819771455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1128104840 0x7f1128104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 -- 172.21.15.29:0/819771455 >> 172.21.15.29:0/819771455 conn(0x7f1128079730 msgr2=0x7f1128079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:19.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 -- 172.21.15.29:0/819771455 shutdown_connections 2024-09-21T07:08:19.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.215+0000 7f112e545640 1 -- 172.21.15.29:0/819771455 wait complete. 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 Processor -- start 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 -- start start 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1128104840 0x7f112819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112810ddf0 0x7f112819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1128113ad0 con 0x7f1128105270 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1128113950 con 0x7f112810ddf0 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f112e545640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1128113c50 con 0x7f1128104840 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f111ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.216+0000 7f111ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58768/0 (socket says 172.21.15.29:58768) 2024-09-21T07:08:19.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f111ffff640 1 -- 172.21.15.29:0/4016557936 learned_addr learned my addr 172.21.15.29:0/4016557936 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f112cae2640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112810ddf0 0x7f112819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f1127fff640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1128104840 0x7f112819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f111ffff640 1 -- 172.21.15.29:0/4016557936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1128104840 msgr2=0x7f112819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f111ffff640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1128104840 0x7f112819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f111ffff640 1 -- 172.21.15.29:0/4016557936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112810ddf0 msgr2=0x7f112819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f111ffff640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112810ddf0 0x7f112819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f111ffff640 1 -- 172.21.15.29:0/4016557936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11281a04b0 con 0x7f1128105270 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f111ffff640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112819aae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f111002a930 tx=0x7f1110004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f1125ffb640 1 -- 172.21.15.29:0/4016557936 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111003f030 con 0x7f1128105270 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f1125ffb640 1 -- 172.21.15.29:0/4016557936 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1110003aa0 con 0x7f1128105270 2024-09-21T07:08:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11281a0740 con 0x7f1128105270 2024-09-21T07:08:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f1125ffb640 1 -- 172.21.15.29:0/4016557936 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110035070 con 0x7f1128105270 2024-09-21T07:08:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.217+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11281a6f00 con 0x7f1128105270 2024-09-21T07:08:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.218+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1128104c50 con 0x7f1128105270 2024-09-21T07:08:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.220+0000 7f1125ffb640 1 -- 172.21.15.29:0/4016557936 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1110042030 con 0x7f1128105270 2024-09-21T07:08:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.221+0000 7f1125ffb640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f11140b65a0 0x7f11140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.221+0000 7f1127fff640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f11140b65a0 0x7f11140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.221+0000 7f1125ffb640 1 -- 172.21.15.29:0/4016557936 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1110107f80 con 0x7f1128105270 2024-09-21T07:08:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.221+0000 7f1127fff640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f11140b65a0 0x7f11140b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f112806bc00 tx=0x7f1118008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:19.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.224+0000 7f1125ffb640 1 -- 172.21.15.29:0/4016557936 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11100ce660 con 0x7f1128105270 2024-09-21T07:08:19.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.411+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f112819b670 con 0x7f1128105270 2024-09-21T07:08:19.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.412+0000 7f1125ffb640 1 -- 172.21.15.29:0/4016557936 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22640 (secure 0 0 0) 0x7f112819b670 con 0x7f1128105270 2024-09-21T07:08:19.414 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:19.415 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":75,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:57.657853+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:08:19.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f11140b65a0 msgr2=0x7f11140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f11140b65a0 0x7f11140b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f112806bc00 tx=0x7f1118008040 comp rx=0 tx=0).stop 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 msgr2=0x7f112819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112819aae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f111002a930 tx=0x7f1110004270 comp rx=0 tx=0).stop 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 shutdown_connections 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f11140b65a0 0x7f11140b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f112810ddf0 0x7f112819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1128105270 0x7f112819aae0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 --2- 172.21.15.29:0/4016557936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1128104840 0x7f112819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 >> 172.21.15.29:0/4016557936 conn(0x7f1128079730 msgr2=0x7f1128100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 shutdown_connections 2024-09-21T07:08:19.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:19.415+0000 7f112e545640 1 -- 172.21.15.29:0/4016557936 wait complete. 2024-09-21T07:08:19.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:19 smithi052 ceph-mon[34308]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T07:08:19.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:19 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4016557936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:20.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:19 smithi066 ceph-mon[34793]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T07:08:20.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:19 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4016557936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:20.118 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:19 smithi029 ceph-mon[30983]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-21T07:08:20.119 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:19 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4016557936' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:08:20.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T07:08:20.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T07:08:20.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T07:08:20.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T07:08:20.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T07:08:20.174 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T07:08:20.174 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T07:08:20.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T07:08:20.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T07:08:20.176 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T07:08:20.176 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T07:08:20.177 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T07:08:20.895 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:20.940 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 -- 172.21.15.29:0/3916853109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc1052f0 msgr2=0x7fb4fc10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 --2- 172.21.15.29:0/3916853109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc1052f0 0x7fb4fc10d930 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009900 tx=0x7fb4f002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 -- 172.21.15.29:0/3916853109 shutdown_connections 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 --2- 172.21.15.29:0/3916853109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4fc10de70 0x7fb4fc110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 --2- 172.21.15.29:0/3916853109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc1052f0 0x7fb4fc10d930 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 --2- 172.21.15.29:0/3916853109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4fc1048c0 0x7fb4fc104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 -- 172.21.15.29:0/3916853109 >> 172.21.15.29:0/3916853109 conn(0x7fb4fc079770 msgr2=0x7fb4fc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 -- 172.21.15.29:0/3916853109 shutdown_connections 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.716+0000 7fb502699640 1 -- 172.21.15.29:0/3916853109 wait complete. 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 Processor -- start 2024-09-21T07:08:21.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 -- start start 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4fc1048c0 0x7fb4fc1027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4fc1052f0 0x7fb4fc102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc10de70 0x7fb4fc103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc113ab0 con 0x7fb4fc10de70 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc113930 con 0x7fb4fc1048c0 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb502699640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb4fc113c30 con 0x7fb4fc1052f0 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb500c36640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc10de70 0x7fb4fc103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb500c36640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc10de70 0x7fb4fc103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58822/0 (socket says 172.21.15.29:58822) 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb500c36640 1 -- 172.21.15.29:0/2469062109 learned_addr learned my addr 172.21.15.29:0/2469062109 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb4fb7fe640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4fc1052f0 0x7fb4fc102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb4fbfff640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4fc1048c0 0x7fb4fc1027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.717+0000 7fb500c36640 1 -- 172.21.15.29:0/2469062109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4fc1052f0 msgr2=0x7fb4fc102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:21.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb500c36640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4fc1052f0 0x7fb4fc102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb500c36640 1 -- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4fc1048c0 msgr2=0x7fb4fc1027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb500c36640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4fc1048c0 0x7fb4fc1027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb500c36640 1 -- 172.21.15.29:0/2469062109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4fc1a8730 con 0x7fb4fc10de70 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb4fb7fe640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4fc1052f0 0x7fb4fc102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb500c36640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc10de70 0x7fb4fc103250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400cce0 tx=0x7fb4f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400f450 con 0x7fb4fc10de70 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4fc1a8a20 con 0x7fb4fc10de70 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4f400faa0 con 0x7fb4fc10de70 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4018b70 con 0x7fb4fc10de70 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.718+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4fc1a8f30 con 0x7fb4fc10de70 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.719+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4fc063ad0 con 0x7fb4fc10de70 2024-09-21T07:08:21.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.721+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb4f4018d10 con 0x7fb4fc10de70 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.721+0000 7fb4f97fa640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb4e40b65a0 0x7fb4e40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb4f40e7c40 con 0x7fb4fc10de70 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4fbfff640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb4e40b65a0 0x7fb4e40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4f97fa640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] conn(0x7fb4e40c0090 0x7fb4e40c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 --> [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4f4012ec0 con 0x7fb4e40c0090 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fb4f40e8090 con 0x7fb4fc10de70 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4fb7fe640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] conn(0x7fb4e40c0090 0x7fb4e40c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4fbfff640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb4e40b65a0 0x7fb4e40b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc104220 tx=0x7fb4ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.722+0000 7fb4fb7fe640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] conn(0x7fb4e40c0090 0x7fb4e40c2580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:21.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.723+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== osd.10 v2:172.21.15.52:6824/1774195182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb4f4012ec0 con 0x7fb4e40c0090 2024-09-21T07:08:21.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.738+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 --> [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4fc063f80 con 0x7fb4e40c0090 2024-09-21T07:08:21.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.738+0000 7fb4f97fa640 1 -- 172.21.15.29:0/2469062109 <== osd.10 v2:172.21.15.52:6824/1774195182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb4fc063f80 con 0x7fb4e40c0090 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] conn(0x7fb4e40c0090 msgr2=0x7fb4e40c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] conn(0x7fb4e40c0090 0x7fb4e40c2580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb4e40b65a0 msgr2=0x7fb4e40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb4e40b65a0 0x7fb4e40b8ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc104220 tx=0x7fb4ec005f90 comp rx=0 tx=0).stop 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc10de70 msgr2=0x7fb4fc103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 --2- 172.21.15.29:0/2469062109 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4fc10de70 0x7fb4fc103250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400cce0 tx=0x7fb4f400a620 comp rx=0 tx=0).stop 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb500c36640 1 -- 172.21.15.29:0/2469062109 reap_dead start 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 shutdown_connections 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 >> 172.21.15.29:0/2469062109 conn(0x7fb4fc079770 msgr2=0x7fb4fc0ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:21.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 shutdown_connections 2024-09-21T07:08:21.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.739+0000 7fb502699640 1 -- 172.21.15.29:0/2469062109 wait complete. 2024-09-21T07:08:21.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:21 smithi052 ceph-mon[34308]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T07:08:22.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:21 smithi066 ceph-mon[34793]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T07:08:22.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:21 smithi029 ceph-mon[30983]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T07:08:22.510 INFO:teuthology.orchestra.run.smithi029.stdout:266287972380 2024-09-21T07:08:22.510 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T07:08:22.565 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:22.573 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:22.574 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:22.577 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:22.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.628+0000 7fc71682c640 1 -- 172.21.15.29:0/1674777989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 msgr2=0x7fc710102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:22.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.628+0000 7fc71682c640 1 --2- 172.21.15.29:0/1674777989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 0x7fc710102e70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc700009900 tx=0x7fc70002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:22.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 -- 172.21.15.29:0/1674777989 shutdown_connections 2024-09-21T07:08:22.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 --2- 172.21.15.29:0/1674777989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc710108cf0 0x7fc71010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:22.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 --2- 172.21.15.29:0/1674777989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7101083a0 0x7fc7101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:22.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 --2- 172.21.15.29:0/1674777989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 0x7fc710102e70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:22.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 -- 172.21.15.29:0/1674777989 >> 172.21.15.29:0/1674777989 conn(0x7fc710079730 msgr2=0x7fc710079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 -- 172.21.15.29:0/1674777989 shutdown_connections 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 -- 172.21.15.29:0/1674777989 wait complete. 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 Processor -- start 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.629+0000 7fc71682c640 1 -- start start 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc71682c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 0x7fc71019b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc71682c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7101083a0 0x7fc71019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc71682c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710108cf0 0x7fc71019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc71682c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc710112960 con 0x7fc710102a60 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc71682c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101127e0 con 0x7fc7101083a0 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc71682c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc710112ae0 con 0x7fc710108cf0 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 0x7fc71019b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 0x7fc71019b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58790/0 (socket says 172.21.15.29:58790) 2024-09-21T07:08:22.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 -- 172.21.15.29:0/2588723256 learned_addr learned my addr 172.21.15.29:0/2588723256 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70f7fe640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7101083a0 0x7fc71019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc714dc9640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710108cf0 0x7fc71019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 -- 172.21.15.29:0/2588723256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710108cf0 msgr2=0x7fc71019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710108cf0 0x7fc71019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 -- 172.21.15.29:0/2588723256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7101083a0 msgr2=0x7fc71019b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7101083a0 0x7fc71019b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:22.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70ffff640 1 -- 172.21.15.29:0/2588723256 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7101a6540 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc70f7fe640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7101083a0 0x7fc71019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.630+0000 7fc714dc9640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc710108cf0 0x7fc71019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.631+0000 7fc70ffff640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 0x7fc71019b230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc700005940 tx=0x7fc7000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.631+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70003f030 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.631+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc700003cb0 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.631+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7101a67d0 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.631+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc700035070 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.631+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7101a6cb0 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.632+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc710063b50 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.634+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc700042030 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc70d7fa640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc6f80b65a0 0x7fc6f80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc70f7fe640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc6f80b65a0 0x7fc6f80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc7001080c0 con 0x7fc710102a60 2024-09-21T07:08:22.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc70d7fa640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] conn(0x7fc6f80c0090 0x7fc6f80c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 --> [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6f80c2c50 con 0x7fc6f80c0090 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fc700108510 con 0x7fc710102a60 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc714dc9640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] conn(0x7fc6f80c0090 0x7fc6f80c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.635+0000 7fc70f7fe640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc6f80b65a0 0x7fc6f80b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7040058c0 tx=0x7fc704005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.636+0000 7fc714dc9640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] conn(0x7fc6f80c0090 0x7fc6f80c2580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.636+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== osd.0 v2:172.21.15.29:6802/2373940457 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6f80c2c50 con 0x7fc6f80c0090 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.650+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 --> [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc710063fd0 con 0x7fc6f80c0090 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc70d7fa640 1 -- 172.21.15.29:0/2588723256 <== osd.0 v2:172.21.15.29:6802/2373940457 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc710063fd0 con 0x7fc6f80c0090 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] conn(0x7fc6f80c0090 msgr2=0x7fc6f80c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] conn(0x7fc6f80c0090 0x7fc6f80c2580 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc6f80b65a0 msgr2=0x7fc6f80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc6f80b65a0 0x7fc6f80b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7040058c0 tx=0x7fc704005850 comp rx=0 tx=0).stop 2024-09-21T07:08:22.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 msgr2=0x7fc71019b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 --2- 172.21.15.29:0/2588723256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc710102a60 0x7fc71019b230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc700005940 tx=0x7fc7000042f0 comp rx=0 tx=0).stop 2024-09-21T07:08:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc714dc9640 1 -- 172.21.15.29:0/2588723256 reap_dead start 2024-09-21T07:08:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 shutdown_connections 2024-09-21T07:08:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 >> 172.21.15.29:0/2588723256 conn(0x7fc710079730 msgr2=0x7fc7101014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 shutdown_connections 2024-09-21T07:08:22.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:21.651+0000 7fc71682c640 1 -- 172.21.15.29:0/2588723256 wait complete. 2024-09-21T07:08:23.309 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:23.309 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:23.309 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:23.310 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:23.325 INFO:teuthology.orchestra.run.smithi029.stdout:34359738448 2024-09-21T07:08:23.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T07:08:23.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:23 smithi052 ceph-mon[34308]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:08:24.044 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:23 smithi029 ceph-mon[30983]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:08:24.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:23 smithi066 ceph-mon[34793]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:08:24.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 -- 172.21.15.29:0/53560286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4102ae0 msgr2=0x7f2ff4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 --2- 172.21.15.29:0/53560286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4102ae0 0x7f2ff4102ef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009900 tx=0x7f2fe402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 -- 172.21.15.29:0/53560286 shutdown_connections 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 --2- 172.21.15.29:0/53560286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ff4108d20 0x7f2ff410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 --2- 172.21.15.29:0/53560286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff41083d0 0x7f2ff41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 --2- 172.21.15.29:0/53560286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4102ae0 0x7f2ff4102ef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 -- 172.21.15.29:0/53560286 >> 172.21.15.29:0/53560286 conn(0x7f2ff4079760 msgr2=0x7f2ff4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 -- 172.21.15.29:0/53560286 shutdown_connections 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 -- 172.21.15.29:0/53560286 wait complete. 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 Processor -- start 2024-09-21T07:08:24.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.136+0000 7f2ffa456640 1 -- start start 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ffa456640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ff4102ae0 0x7f2ff410ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ffa456640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff41083d0 0x7f2ff4110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ffa456640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4108d20 0x7f2ff4110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ffa456640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4113ae0 con 0x7f2ff4108d20 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ffa456640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4113960 con 0x7f2ff41083d0 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ffa456640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4113c60 con 0x7f2ff4102ae0 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4108d20 0x7f2ff4110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4108d20 0x7f2ff4110a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58840/0 (socket says 172.21.15.29:58840) 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 -- 172.21.15.29:0/3444209247 learned_addr learned my addr 172.21.15.29:0/3444209247 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff3fff640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ff4102ae0 0x7f2ff410ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:24.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff37fe640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff41083d0 0x7f2ff4110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 -- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ff4102ae0 msgr2=0x7f2ff410ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ff4102ae0 0x7f2ff410ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 -- 172.21.15.29:0/3444209247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff41083d0 msgr2=0x7f2ff4110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ff41083d0 0x7f2ff4110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff89f3640 1 -- 172.21.15.29:0/3444209247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff41a8750 con 0x7f2ff4108d20 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.137+0000 7f2ff3fff640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ff4102ae0 0x7f2ff410ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.138+0000 7f2ff89f3640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4108d20 0x7f2ff4110a60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00eaa0 tx=0x7f2fec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.138+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00cdb0 con 0x7f2ff4108d20 2024-09-21T07:08:24.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.138+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fec005020 con 0x7f2ff4108d20 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.138+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0116d0 con 0x7f2ff4108d20 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.138+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff41a8a40 con 0x7f2ff4108d20 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.138+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff41a8f80 con 0x7f2ff4108d20 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.139+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ff4063b50 con 0x7f2ff4108d20 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.141+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2fec0051d0 con 0x7f2ff4108d20 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.141+0000 7f2ff17fa640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2fe00b65a0 0x7f2fe00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.141+0000 7f2ff3fff640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2fe00b65a0 0x7f2fe00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.141+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2fec0e7c40 con 0x7f2ff4108d20 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.142+0000 7f2ff17fa640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] conn(0x7f2fe00c0090 0x7f2fe00c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.142+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 --> [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fec014ec0 con 0x7f2fe00c0090 2024-09-21T07:08:24.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.142+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f2fec0e8090 con 0x7f2ff4108d20 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.142+0000 7f2ff3fff640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2fe00b65a0 0x7f2fe00b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4005ab0 tx=0x7f2fe4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.142+0000 7f2ff37fe640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] conn(0x7f2fe00c0090 0x7f2fe00c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.142+0000 7f2ff37fe640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] conn(0x7f2fe00c0090 0x7f2fe00c2580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.143+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== osd.2 v2:172.21.15.66:6800/318756660 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fec014ec0 con 0x7f2fe00c0090 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.157+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 --> [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ff4063f50 con 0x7f2fe00c0090 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ff17fa640 1 -- 172.21.15.29:0/3444209247 <== osd.2 v2:172.21.15.66:6800/318756660 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ff4063f50 con 0x7f2fe00c0090 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] conn(0x7f2fe00c0090 msgr2=0x7f2fe00c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] conn(0x7f2fe00c0090 0x7f2fe00c2580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2fe00b65a0 msgr2=0x7f2fe00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2fe00b65a0 0x7f2fe00b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4005ab0 tx=0x7f2fe4000bc0 comp rx=0 tx=0).stop 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4108d20 msgr2=0x7f2ff4110a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:24.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 --2- 172.21.15.29:0/3444209247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff4108d20 0x7f2ff4110a60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00eaa0 tx=0x7f2fec00ef60 comp rx=0 tx=0).stop 2024-09-21T07:08:24.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ff89f3640 1 -- 172.21.15.29:0/3444209247 reap_dead start 2024-09-21T07:08:24.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 shutdown_connections 2024-09-21T07:08:24.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 >> 172.21.15.29:0/3444209247 conn(0x7f2ff4079760 msgr2=0x7f2ff4101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:24.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 shutdown_connections 2024-09-21T07:08:24.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:24.158+0000 7f2ffa456640 1 -- 172.21.15.29:0/3444209247 wait complete. 2024-09-21T07:08:25.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 -- 172.21.15.29:0/4092140213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 msgr2=0x7f2a08110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 --2- 172.21.15.29:0/4092140213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 0x7f2a08110330 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009ca0 tx=0x7f2a0002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 -- 172.21.15.29:0/4092140213 shutdown_connections 2024-09-21T07:08:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 --2- 172.21.15.29:0/4092140213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 0x7f2a08110330 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 --2- 172.21.15.29:0/4092140213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a08105380 0x7f2a0810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 --2- 172.21.15.29:0/4092140213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08104a30 0x7f2a08104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 -- 172.21.15.29:0/4092140213 >> 172.21.15.29:0/4092140213 conn(0x7f2a08079760 msgr2=0x7f2a08079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 -- 172.21.15.29:0/4092140213 shutdown_connections 2024-09-21T07:08:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.387+0000 7f2a0c885640 1 -- 172.21.15.29:0/4092140213 wait complete. 2024-09-21T07:08:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 Processor -- start 2024-09-21T07:08:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 -- start start 2024-09-21T07:08:25.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08104a30 0x7f2a08102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a08105380 0x7f2a08102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 0x7f2a081031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08113ac0 con 0x7f2a0810de60 2024-09-21T07:08:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08113940 con 0x7f2a08105380 2024-09-21T07:08:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.388+0000 7f2a0c885640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08113c40 con 0x7f2a08104a30 2024-09-21T07:08:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 0x7f2a081031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 0x7f2a081031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58878/0 (socket says 172.21.15.29:58878) 2024-09-21T07:08:25.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 -- 172.21.15.29:0/94173681 learned_addr learned my addr 172.21.15.29:0/94173681 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:25.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a0659c640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08104a30 0x7f2a08102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a05d9b640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a08105380 0x7f2a08102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 -- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08104a30 msgr2=0x7f2a08102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08104a30 0x7f2a08102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 -- 172.21.15.29:0/94173681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a08105380 msgr2=0x7f2a08102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a08105380 0x7f2a08102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 -- 172.21.15.29:0/94173681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081a87d0 con 0x7f2a0810de60 2024-09-21T07:08:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a05d9b640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a08105380 0x7f2a08102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a06d9d640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 0x7f2a081031f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005cc0 tx=0x7f2a0002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00003bf0 con 0x7f2a0810de60 2024-09-21T07:08:25.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a00003d90 con 0x7f2a0810de60 2024-09-21T07:08:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0002fbc0 con 0x7f2a0810de60 2024-09-21T07:08:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a081a8a60 con 0x7f2a0810de60 2024-09-21T07:08:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.389+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a081a8fa0 con 0x7f2a0810de60 2024-09-21T07:08:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.390+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a08100fc0 con 0x7f2a0810de60 2024-09-21T07:08:25.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.392+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2a0002fd60 con 0x7f2a0810de60 2024-09-21T07:08:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f29f77fe640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f29f00b65a0 0x7f29f00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f2a0659c640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f29f00b65a0 0x7f29f00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2a00108be0 con 0x7f2a0810de60 2024-09-21T07:08:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f29f77fe640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] conn(0x7f29f00c0090 0x7f29f00c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 --> [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29f00c2c50 con 0x7f29f00c0090 2024-09-21T07:08:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f2a00108f90 con 0x7f2a0810de60 2024-09-21T07:08:25.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f2a0659c640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f29f00b65a0 0x7f29f00b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a081041c0 tx=0x7f29f800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.393+0000 7f2a05d9b640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] conn(0x7f29f00c0090 0x7f29f00c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.394+0000 7f2a05d9b640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] conn(0x7f29f00c0090 0x7f29f00c2580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:25.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.395+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== osd.8 v2:172.21.15.66:6816/1991639723 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29f00c2c50 con 0x7f29f00c0090 2024-09-21T07:08:25.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.408+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 --> [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a0806b350 con 0x7f29f00c0090 2024-09-21T07:08:25.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f29f77fe640 1 -- 172.21.15.29:0/94173681 <== osd.8 v2:172.21.15.66:6816/1991639723 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2a0806b350 con 0x7f29f00c0090 2024-09-21T07:08:25.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] conn(0x7f29f00c0090 msgr2=0x7f29f00c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] conn(0x7f29f00c0090 0x7f29f00c2580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f29f00b65a0 msgr2=0x7f29f00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f29f00b65a0 0x7f29f00b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a081041c0 tx=0x7f29f800b390 comp rx=0 tx=0).stop 2024-09-21T07:08:25.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 msgr2=0x7f2a081031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 --2- 172.21.15.29:0/94173681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a0810de60 0x7f2a081031f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005cc0 tx=0x7f2a0002f380 comp rx=0 tx=0).stop 2024-09-21T07:08:25.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a06d9d640 1 -- 172.21.15.29:0/94173681 reap_dead start 2024-09-21T07:08:25.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 shutdown_connections 2024-09-21T07:08:25.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.409+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 >> 172.21.15.29:0/94173681 conn(0x7f2a08079760 msgr2=0x7f2a080ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:25.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.410+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 shutdown_connections 2024-09-21T07:08:25.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.410+0000 7f2a0c885640 1 -- 172.21.15.29:0/94173681 wait complete. 2024-09-21T07:08:25.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/3788121431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 msgr2=0x7fe9b0109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 --2- 172.21.15.29:0/3788121431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 0x7fe9b0109900 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009900 tx=0x7fe9a402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:25.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/3788121431 shutdown_connections 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 --2- 172.21.15.29:0/3788121431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9b0109e40 0x7fe9b0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 --2- 172.21.15.29:0/3788121431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 0x7fe9b0109900 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 --2- 172.21.15.29:0/3788121431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9b0103bb0 0x7fe9b0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/3788121431 >> 172.21.15.29:0/3788121431 conn(0x7fe9b00ff600 msgr2=0x7fe9b0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/3788121431 shutdown_connections 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.187+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/3788121431 wait complete. 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.188+0000 7fe9b5d3c640 1 Processor -- start 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.188+0000 7fe9b5d3c640 1 -- start start 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.188+0000 7fe9b5d3c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9b0103bb0 0x7fe9b019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.188+0000 7fe9b5d3c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 0x7fe9b019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.188+0000 7fe9b5d3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9b0109e40 0x7fe9b019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.188+0000 7fe9b5d3c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0113b00 con 0x7fe9b01094f0 2024-09-21T07:08:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.188+0000 7fe9b5d3c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0113980 con 0x7fe9b0109e40 2024-09-21T07:08:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9b5d3c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0113c80 con 0x7fe9b0103bb0 2024-09-21T07:08:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 0x7fe9b019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 0x7fe9b019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58872/0 (socket says 172.21.15.29:58872) 2024-09-21T07:08:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 -- 172.21.15.29:0/2828154119 learned_addr learned my addr 172.21.15.29:0/2828154119 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9affff640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9b0109e40 0x7fe9b019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9af7fe640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9b0103bb0 0x7fe9b019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 -- 172.21.15.29:0/2828154119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9b0103bb0 msgr2=0x7fe9b019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9b0103bb0 0x7fe9b019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 -- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9b0109e40 msgr2=0x7fe9b019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9b0109e40 0x7fe9b019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 -- 172.21.15.29:0/2828154119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b01a0460 con 0x7fe9b01094f0 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9affff640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9b0109e40 0x7fe9b019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9aeffd640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 0x7fe9b019aa90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe9a402a930 tx=0x7fe9a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a403f030 con 0x7fe9b01094f0 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b01a06f0 con 0x7fe9b01094f0 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9a4003aa0 con 0x7fe9b01094f0 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.189+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4035070 con 0x7fe9b01094f0 2024-09-21T07:08:25.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.190+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b01a6eb0 con 0x7fe9b01094f0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.190+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9b0063b50 con 0x7fe9b01094f0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.192+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe9a4042030 con 0x7fe9b01094f0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9acff9640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9980b65a0 0x7fe9980b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9af7fe640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9980b65a0 0x7fe9980b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe9a4108130 con 0x7fe9b01094f0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9acff9640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] conn(0x7fe9980c0090 0x7fe9980c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 --> [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9a404eea0 con 0x7fe9980c0090 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fe9a41084e0 con 0x7fe9b01094f0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9af7fe640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9980b65a0 0x7fe9980b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005fd0 tx=0x7fe9a0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.193+0000 7fe9affff640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] conn(0x7fe9980c0090 0x7fe9980c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.194+0000 7fe9affff640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] conn(0x7fe9980c0090 0x7fe9980c2580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.195+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== osd.1 v2:172.21.15.52:6800/1978715722 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9a404eea0 con 0x7fe9980c0090 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.208+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 --> [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe9b0063fd0 con 0x7fe9980c0090 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.209+0000 7fe9acff9640 1 -- 172.21.15.29:0/2828154119 <== osd.1 v2:172.21.15.52:6800/1978715722 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe9b0063fd0 con 0x7fe9980c0090 2024-09-21T07:08:25.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.209+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] conn(0x7fe9980c0090 msgr2=0x7fe9980c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.209+0000 7fe9b5d3c640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] conn(0x7fe9980c0090 0x7fe9980c2580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9980b65a0 msgr2=0x7fe9980b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe9980b65a0 0x7fe9980b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005fd0 tx=0x7fe9a0005850 comp rx=0 tx=0).stop 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 msgr2=0x7fe9b019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 --2- 172.21.15.29:0/2828154119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b01094f0 0x7fe9b019aa90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe9a402a930 tx=0x7fe9a4004270 comp rx=0 tx=0).stop 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9affff640 1 -- 172.21.15.29:0/2828154119 reap_dead start 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 shutdown_connections 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 >> 172.21.15.29:0/2828154119 conn(0x7fe9b00ff600 msgr2=0x7fe9b0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 shutdown_connections 2024-09-21T07:08:25.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.210+0000 7fe9b5d3c640 1 -- 172.21.15.29:0/2828154119 wait complete. 2024-09-21T07:08:25.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:25 smithi052 ceph-mon[34308]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:08:26.058 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:25 smithi029 ceph-mon[30983]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:08:26.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:25 smithi066 ceph-mon[34793]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-21T07:08:26.418 INFO:teuthology.orchestra.run.smithi029.stdout:219043332135 2024-09-21T07:08:26.419 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T07:08:27.078 INFO:teuthology.orchestra.run.smithi029.stdout:77309411398 2024-09-21T07:08:27.078 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T07:08:27.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/1762266843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48106c20 msgr2=0x7f4b481106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:27.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 --2- 172.21.15.29:0/1762266843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48106c20 0x7f4b481106b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009900 tx=0x7f4b4002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/1762266843 shutdown_connections 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 --2- 172.21.15.29:0/1762266843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48106c20 0x7f4b481106b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 --2- 172.21.15.29:0/1762266843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b481062d0 0x7f4b481066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 --2- 172.21.15.29:0/1762266843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b48102080 0x7f4b48102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/1762266843 >> 172.21.15.29:0/1762266843 conn(0x7f4b48079f90 msgr2=0x7f4b4807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/1762266843 shutdown_connections 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.673+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/1762266843 wait complete. 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 Processor -- start 2024-09-21T07:08:27.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 -- start start 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48102080 0x7f4b4819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b481062d0 0x7f4b4819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b48106c20 0x7f4b4819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4b48113b10 con 0x7f4b48102080 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b48113990 con 0x7f4b48106c20 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4cfe4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4b48113c90 con 0x7f4b481062d0 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48102080 0x7f4b4819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:27.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48102080 0x7f4b4819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35456/0 (socket says 172.21.15.29:35456) 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 -- 172.21.15.29:0/2549983055 learned_addr learned my addr 172.21.15.29:0/2549983055 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b45d9b640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b481062d0 0x7f4b4819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b46d9d640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b48106c20 0x7f4b4819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 -- 172.21.15.29:0/2549983055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b481062d0 msgr2=0x7f4b4819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b481062d0 0x7f4b4819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 -- 172.21.15.29:0/2549983055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b48106c20 msgr2=0x7f4b4819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b48106c20 0x7f4b4819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b4659c640 1 -- 172.21.15.29:0/2549983055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b481a0450 con 0x7f4b48102080 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.674+0000 7f4b46d9d640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b48106c20 0x7f4b4819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.675+0000 7f4b4659c640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48102080 0x7f4b4819a4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800eaa0 tx=0x7f4b3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.675+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38016070 con 0x7f4b48102080 2024-09-21T07:08:27.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.675+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b481a0740 con 0x7f4b48102080 2024-09-21T07:08:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.675+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b38003e20 con 0x7f4b48102080 2024-09-21T07:08:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.675+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b380116d0 con 0x7f4b48102080 2024-09-21T07:08:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.675+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b481a6ea0 con 0x7f4b48102080 2024-09-21T07:08:27.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.676+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b48063b50 con 0x7f4b48102080 2024-09-21T07:08:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.678+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4b38019070 con 0x7f4b48102080 2024-09-21T07:08:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.678+0000 7f4b377fe640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4b300b65a0 0x7f4b300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.678+0000 7f4b45d9b640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4b300b65a0 0x7f4b300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.678+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4b380e7960 con 0x7f4b48102080 2024-09-21T07:08:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.679+0000 7f4b377fe640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] conn(0x7f4b300c0090 0x7f4b300c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.679+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 --> [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b38021e50 con 0x7f4b300c0090 2024-09-21T07:08:27.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.679+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f4b380e7db0 con 0x7f4b48102080 2024-09-21T07:08:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.679+0000 7f4b46d9d640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] conn(0x7f4b300c0090 0x7f4b300c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.679+0000 7f4b45d9b640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4b300b65a0 0x7f4b300b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b481091f0 tx=0x7f4b3c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.679+0000 7f4b46d9d640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] conn(0x7f4b300c0090 0x7f4b300c2580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:27.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.680+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== osd.6 v2:172.21.15.29:6818/3038729725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b38021e50 con 0x7f4b300c0090 2024-09-21T07:08:27.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 --> [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b48063fd0 con 0x7f4b300c0090 2024-09-21T07:08:27.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b377fe640 1 -- 172.21.15.29:0/2549983055 <== osd.6 v2:172.21.15.29:6818/3038729725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4b48063fd0 con 0x7f4b300c0090 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] conn(0x7f4b300c0090 msgr2=0x7f4b300c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] conn(0x7f4b300c0090 0x7f4b300c2580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4b300b65a0 msgr2=0x7f4b300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4b300b65a0 0x7f4b300b8ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b481091f0 tx=0x7f4b3c00a2d0 comp rx=0 tx=0).stop 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48102080 msgr2=0x7f4b4819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 --2- 172.21.15.29:0/2549983055 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b48102080 0x7f4b4819a4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800eaa0 tx=0x7f4b3800ef60 comp rx=0 tx=0).stop 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b46d9d640 1 -- 172.21.15.29:0/2549983055 reap_dead start 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 shutdown_connections 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.694+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 >> 172.21.15.29:0/2549983055 conn(0x7f4b48079f90 msgr2=0x7f4b48107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.695+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 shutdown_connections 2024-09-21T07:08:27.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:27.695+0000 7f4b4cfe4640 1 -- 172.21.15.29:0/2549983055 wait complete. 2024-09-21T07:08:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:27 smithi052 ceph-mon[34308]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T07:08:28.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:27 smithi029 ceph-mon[30983]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T07:08:28.085 INFO:teuthology.orchestra.run.smithi029.stdout:55834574923 2024-09-21T07:08:28.085 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T07:08:28.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:27 smithi066 ceph-mon[34793]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-21T07:08:28.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 -- 172.21.15.29:0/3640128175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a40760a0 msgr2=0x7f90a410fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:28.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 --2- 172.21.15.29:0/3640128175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a40760a0 0x7f90a410fc10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9094009900 tx=0x7f909402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:28.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 -- 172.21.15.29:0/3640128175 shutdown_connections 2024-09-21T07:08:28.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 --2- 172.21.15.29:0/3640128175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90a4110150 0x7f90a4112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 --2- 172.21.15.29:0/3640128175 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a40760a0 0x7f90a410fc10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 --2- 172.21.15.29:0/3640128175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a4075750 0x7f90a4075b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 -- 172.21.15.29:0/3640128175 >> 172.21.15.29:0/3640128175 conn(0x7f90a40ff5e0 msgr2=0x7f90a4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 -- 172.21.15.29:0/3640128175 shutdown_connections 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.257+0000 7f90aba54640 1 -- 172.21.15.29:0/3640128175 wait complete. 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 Processor -- start 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 -- start start 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a4075750 0x7f90a419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a40760a0 0x7f90a419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90a4110150 0x7f90a41a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4115ce0 con 0x7f90a4075750 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4115b60 con 0x7f90a4110150 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.258+0000 7f90aba54640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f90a4115e60 con 0x7f90a40760a0 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a4075750 0x7f90a419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a4075750 0x7f90a419c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35486/0 (socket says 172.21.15.29:35486) 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 -- 172.21.15.29:0/2652737874 learned_addr learned my addr 172.21.15.29:0/2652737874 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a9ff1640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90a4110150 0x7f90a41a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a8fef640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a40760a0 0x7f90a419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 -- 172.21.15.29:0/2652737874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a40760a0 msgr2=0x7f90a419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a40760a0 0x7f90a419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 -- 172.21.15.29:0/2652737874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90a4110150 msgr2=0x7f90a41a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90a4110150 0x7f90a41a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 -- 172.21.15.29:0/2652737874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a41a26c0 con 0x7f90a4075750 2024-09-21T07:08:28.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90a97f0640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a4075750 0x7f90a419c750 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b4a0 tx=0x7f90a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0014070 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a41a29b0 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90a0010ac0 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.259+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0017c30 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.260+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a41a9110 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.261+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90a410a750 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.262+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f90a0017070 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.263+0000 7f909a7fc640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90900b65a0 0x7f90900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.263+0000 7f90a8fef640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90900b65a0 0x7f90900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.263+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f90a00e6b50 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.263+0000 7f909a7fc640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] conn(0x7f90900c0090 0x7f90900c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.263+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 --> [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90900c2c50 con 0x7f90900c0090 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.263+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f90a00e6fa0 con 0x7f90a4075750 2024-09-21T07:08:28.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.263+0000 7f90a9ff1640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] conn(0x7f90900c0090 0x7f90900c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:28.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.264+0000 7f90a8fef640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90900b65a0 0x7f90900b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9094009230 tx=0x7f9094031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:28.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.264+0000 7f90a9ff1640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] conn(0x7f90900c0090 0x7f90900c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:28.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.264+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== osd.9 v2:172.21.15.29:6826/2032308590 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90900c2c50 con 0x7f90900c0090 2024-09-21T07:08:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.283+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 --> [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90a4076c60 con 0x7f90900c0090 2024-09-21T07:08:28.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.283+0000 7f909a7fc640 1 -- 172.21.15.29:0/2652737874 <== osd.9 v2:172.21.15.29:6826/2032308590 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f90a4076c60 con 0x7f90900c0090 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] conn(0x7f90900c0090 msgr2=0x7f90900c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] conn(0x7f90900c0090 0x7f90900c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90900b65a0 msgr2=0x7f90900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f90900b65a0 0x7f90900b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9094009230 tx=0x7f9094031400 comp rx=0 tx=0).stop 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a4075750 msgr2=0x7f90a419c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 --2- 172.21.15.29:0/2652737874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90a4075750 0x7f90a419c750 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b4a0 tx=0x7f90a000b960 comp rx=0 tx=0).stop 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90a9ff1640 1 -- 172.21.15.29:0/2652737874 reap_dead start 2024-09-21T07:08:28.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 shutdown_connections 2024-09-21T07:08:28.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 >> 172.21.15.29:0/2652737874 conn(0x7f90a40ff5e0 msgr2=0x7f90a4109cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:28.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 shutdown_connections 2024-09-21T07:08:28.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:28.284+0000 7f90aba54640 1 -- 172.21.15.29:0/2652737874 wait complete. 2024-09-21T07:08:29.652 INFO:teuthology.orchestra.run.smithi029.stdout:171798691890 2024-09-21T07:08:29.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T07:08:29.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:29 smithi029 ceph-mon[30983]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T07:08:29.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:29 smithi052 ceph-mon[34308]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T07:08:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:29 smithi066 ceph-mon[34793]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 -- 172.21.15.29:0/2693121628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a4105330 msgr2=0x7f26a410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 --2- 172.21.15.29:0/2693121628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a4105330 0x7f26a410d880 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2694009900 tx=0x7f269402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 -- 172.21.15.29:0/2693121628 shutdown_connections 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 --2- 172.21.15.29:0/2693121628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a410de40 0x7f26a4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 --2- 172.21.15.29:0/2693121628 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a4105330 0x7f26a410d880 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 --2- 172.21.15.29:0/2693121628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a41049e0 0x7f26a4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 -- 172.21.15.29:0/2693121628 >> 172.21.15.29:0/2693121628 conn(0x7f26a4079750 msgr2=0x7f26a4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 -- 172.21.15.29:0/2693121628 shutdown_connections 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.083+0000 7f26abf8d640 1 -- 172.21.15.29:0/2693121628 wait complete. 2024-09-21T07:08:30.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 Processor -- start 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 -- start start 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a41049e0 0x7f26a419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a4105330 0x7f26a419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a410de40 0x7f26a419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f26a4113ae0 con 0x7f26a41049e0 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26a4113960 con 0x7f26a4105330 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26abf8d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26a4113c60 con 0x7f26a410de40 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26a9d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a41049e0 0x7f26a419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26a9d29640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a41049e0 0x7f26a419a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35510/0 (socket says 172.21.15.29:35510) 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.084+0000 7f26a9d29640 1 -- 172.21.15.29:0/2413114222 learned_addr learned my addr 172.21.15.29:0/2413114222 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26aa52a640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a410de40 0x7f26a419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26a9528640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a4105330 0x7f26a419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26a9d29640 1 -- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a410de40 msgr2=0x7f26a419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26a9d29640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a410de40 0x7f26a419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26a9d29640 1 -- 172.21.15.29:0/2413114222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a4105330 msgr2=0x7f26a419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26a9d29640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a4105330 0x7f26a419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26a9d29640 1 -- 172.21.15.29:0/2413114222 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a41a0480 con 0x7f26a41049e0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26aa52a640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a410de40 0x7f26a419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26a9d29640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a41049e0 0x7f26a419a510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f26a000d770 tx=0x7f26a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0017070 con 0x7f26a41049e0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a0009c30 con 0x7f26a41049e0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a41a0770 con 0x7f26a41049e0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0003cc0 con 0x7f26a41049e0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.085+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a41a6ed0 con 0x7f26a41049e0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.086+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26a4063b50 con 0x7f26a41049e0 2024-09-21T07:08:30.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.088+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f26a0003e60 con 0x7f26a41049e0 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.088+0000 7f269affd640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26900b65a0 0x7f26900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.089+0000 7f26a9528640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26900b65a0 0x7f26900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.089+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f26a00e72a0 con 0x7f26a41049e0 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.089+0000 7f269affd640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] conn(0x7f26900c0090 0x7f26900c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.089+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 --> [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26900c2c50 con 0x7f26900c0090 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.089+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f26a00e76f0 con 0x7f26a41049e0 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.089+0000 7f26a9528640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26900b65a0 0x7f26900b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2694009230 tx=0x7f2694031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.089+0000 7f26aa52a640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] conn(0x7f26900c0090 0x7f26900c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.090+0000 7f26aa52a640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] conn(0x7f26900c0090 0x7f26900c2580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.090+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== osd.11 v2:172.21.15.66:6824/3573709450 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26900c2c50 con 0x7f26900c0090 2024-09-21T07:08:30.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.104+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 --> [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26a4063fd0 con 0x7f26900c0090 2024-09-21T07:08:30.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f269affd640 1 -- 172.21.15.29:0/2413114222 <== osd.11 v2:172.21.15.66:6824/3573709450 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f26a4063fd0 con 0x7f26900c0090 2024-09-21T07:08:30.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] conn(0x7f26900c0090 msgr2=0x7f26900c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] conn(0x7f26900c0090 0x7f26900c2580 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26900b65a0 msgr2=0x7f26900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26900b65a0 0x7f26900b8ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2694009230 tx=0x7f2694031400 comp rx=0 tx=0).stop 2024-09-21T07:08:30.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a41049e0 msgr2=0x7f26a419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 --2- 172.21.15.29:0/2413114222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a41049e0 0x7f26a419a510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f26a000d770 tx=0x7f26a000dc30 comp rx=0 tx=0).stop 2024-09-21T07:08:30.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26aa52a640 1 -- 172.21.15.29:0/2413114222 reap_dead start 2024-09-21T07:08:30.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 shutdown_connections 2024-09-21T07:08:30.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 >> 172.21.15.29:0/2413114222 conn(0x7f26a4079750 msgr2=0x7f26a4100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:30.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 shutdown_connections 2024-09-21T07:08:30.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.105+0000 7f26abf8d640 1 -- 172.21.15.29:0/2413114222 wait complete. 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 -- 172.21.15.29:0/3041276502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a681049c0 msgr2=0x7f4a68104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 --2- 172.21.15.29:0/3041276502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a681049c0 0x7f4a68104dd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009ca0 tx=0x7f4a5802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 -- 172.21.15.29:0/3041276502 shutdown_connections 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 --2- 172.21.15.29:0/3041276502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a6810de20 0x7f4a68110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 --2- 172.21.15.29:0/3041276502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a68105310 0x7f4a6810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 --2- 172.21.15.29:0/3041276502 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a681049c0 0x7f4a68104dd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 -- 172.21.15.29:0/3041276502 >> 172.21.15.29:0/3041276502 conn(0x7f4a68079730 msgr2=0x7f4a68079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 -- 172.21.15.29:0/3041276502 shutdown_connections 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.744+0000 7f4a705e7640 1 -- 172.21.15.29:0/3041276502 wait complete. 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 Processor -- start 2024-09-21T07:08:30.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 -- start start 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a681049c0 0x7f4a68102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a68105310 0x7f4a68102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a6810de20 0x7f4a68103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4a68113ad0 con 0x7f4a6810de20 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4a68113950 con 0x7f4a68105310 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.745+0000 7f4a705e7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4a68113c50 con 0x7f4a681049c0 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a6810de20 0x7f4a68103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a6810de20 0x7f4a68103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35528/0 (socket says 172.21.15.29:35528) 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 -- 172.21.15.29:0/1812076308 learned_addr learned my addr 172.21.15.29:0/1812076308 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6db82640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a68105310 0x7f4a68102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6e383640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a681049c0 0x7f4a68102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 -- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a681049c0 msgr2=0x7f4a68102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a681049c0 0x7f4a68102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 -- 172.21.15.29:0/1812076308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a68105310 msgr2=0x7f4a68102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a68105310 0x7f4a68102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 -- 172.21.15.29:0/1812076308 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a681a87c0 con 0x7f4a6810de20 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a6eb84640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a6810de20 0x7f4a68103180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000d950 tx=0x7f4a6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a60017030 con 0x7f4a6810de20 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a60004020 con 0x7f4a6810de20 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a681a8ab0 con 0x7f4a6810de20 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a60003b50 con 0x7f4a6810de20 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.746+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a681a8f70 con 0x7f4a6810de20 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.747+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a681083a0 con 0x7f4a6810de20 2024-09-21T07:08:30.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.749+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4a6001a070 con 0x7f4a6810de20 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a677fe640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4a500b65a0 0x7f4a500b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a6e383640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4a500b65a0 0x7f4a500b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4a600e7650 con 0x7f4a6810de20 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a677fe640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] conn(0x7f4a500c0090 0x7f4a500c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 --> [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a6001ce50 con 0x7f4a500c0090 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f4a600e7a00 con 0x7f4a6810de20 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a6e383640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4a500b65a0 0x7f4a500b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4a58004af0 tx=0x7f4a58005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.750+0000 7f4a6db82640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] conn(0x7f4a500c0090 0x7f4a500c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.751+0000 7f4a6db82640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] conn(0x7f4a500c0090 0x7f4a500c2580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:30.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.752+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== osd.5 v2:172.21.15.66:6808/3149868590 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a6001ce50 con 0x7f4a500c0090 2024-09-21T07:08:30.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.766+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 --> [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a6806b390 con 0x7f4a500c0090 2024-09-21T07:08:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.766+0000 7f4a677fe640 1 -- 172.21.15.29:0/1812076308 <== osd.5 v2:172.21.15.66:6808/3149868590 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4a6806b390 con 0x7f4a500c0090 2024-09-21T07:08:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] conn(0x7f4a500c0090 msgr2=0x7f4a500c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] conn(0x7f4a500c0090 0x7f4a500c2580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4a500b65a0 msgr2=0x7f4a500b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4a500b65a0 0x7f4a500b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4a58004af0 tx=0x7f4a58005fd0 comp rx=0 tx=0).stop 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a6810de20 msgr2=0x7f4a68103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 --2- 172.21.15.29:0/1812076308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a6810de20 0x7f4a68103180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000d950 tx=0x7f4a6000de10 comp rx=0 tx=0).stop 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a6eb84640 1 -- 172.21.15.29:0/1812076308 reap_dead start 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 shutdown_connections 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 >> 172.21.15.29:0/1812076308 conn(0x7f4a68079730 msgr2=0x7f4a68107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 shutdown_connections 2024-09-21T07:08:30.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:30.767+0000 7f4a705e7640 1 -- 172.21.15.29:0/1812076308 wait complete. 2024-09-21T07:08:31.207 INFO:teuthology.orchestra.run.smithi029.stdout:287762808857 2024-09-21T07:08:31.207 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T07:08:31.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.401+0000 7f2165d3b640 1 -- 172.21.15.29:0/1563775493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21601094d0 msgr2=0x7f21601098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.401+0000 7f2165d3b640 1 --2- 172.21.15.29:0/1563775493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21601094d0 0x7f21601098e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2154009900 tx=0x7f215402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.402+0000 7f2165d3b640 1 -- 172.21.15.29:0/1563775493 shutdown_connections 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.402+0000 7f2165d3b640 1 --2- 172.21.15.29:0/1563775493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2160109e20 0x7f2160110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.402+0000 7f2165d3b640 1 --2- 172.21.15.29:0/1563775493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21601094d0 0x7f21601098e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.402+0000 7f2165d3b640 1 --2- 172.21.15.29:0/1563775493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2160103b90 0x7f2160103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.402+0000 7f2165d3b640 1 -- 172.21.15.29:0/1563775493 >> 172.21.15.29:0/1563775493 conn(0x7f21600ff5e0 msgr2=0x7f2160101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.402+0000 7f2165d3b640 1 -- 172.21.15.29:0/1563775493 shutdown_connections 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.402+0000 7f2165d3b640 1 -- 172.21.15.29:0/1563775493 wait complete. 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 Processor -- start 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 -- start start 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2160103b90 0x7f2160075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21601094d0 0x7f2160075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2160109e20 0x7f2160076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:31.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2160113ae0 con 0x7f2160103b90 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2160113960 con 0x7f21601094d0 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.403+0000 7f2165d3b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2160113c60 con 0x7f2160109e20 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21601094d0 0x7f2160075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21601094d0 0x7f2160075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:40258/0 (socket says 172.21.15.29:40258) 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2160109e20 0x7f2160076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2160109e20 0x7f2160076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.29:40716/0 (socket says 172.21.15.29:40716) 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 -- 172.21.15.29:0/23172632 learned_addr learned my addr 172.21.15.29:0/23172632 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215f7fe640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2160103b90 0x7f2160075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 -- 172.21.15.29:0/23172632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21601094d0 msgr2=0x7f2160075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f21601094d0 0x7f2160075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 -- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2160103b90 msgr2=0x7f2160075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2160103b90 0x7f2160075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:31.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215ffff640 1 -- 172.21.15.29:0/23172632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21601a8730 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.404+0000 7f215f7fe640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2160103b90 0x7f2160075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.405+0000 7f215ffff640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2160109e20 0x7f2160076190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f215800e970 tx=0x7f215800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.405+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215800ccc0 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.405+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f215800ce60 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.405+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21601a8a20 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.405+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2158010430 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.405+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21601a8ee0 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.406+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2160063b50 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.408+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2158004f70 con 0x7f2160109e20 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.409+0000 7f215cff9640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f21480b65a0 0x7f21480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:31.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.409+0000 7f215f7fe640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f21480b65a0 0x7f21480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.409+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f21580e8000 con 0x7f2160109e20 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.409+0000 7f215cff9640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] conn(0x7f21480c0090 0x7f21480c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.409+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 --> [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f215801ee50 con 0x7f21480c0090 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.409+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f21580e83b0 con 0x7f2160109e20 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.409+0000 7f215effd640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] conn(0x7f21480c0090 0x7f21480c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.410+0000 7f215f7fe640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f21480b65a0 0x7f21480b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2160077160 tx=0x7f2150009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.410+0000 7f215effd640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] conn(0x7f21480c0090 0x7f21480c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.411+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== osd.3 v2:172.21.15.29:6810/3285297772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f215801ee50 con 0x7f21480c0090 2024-09-21T07:08:31.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.426+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 --> [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2160063fd0 con 0x7f21480c0090 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.426+0000 7f215cff9640 1 -- 172.21.15.29:0/23172632 <== osd.3 v2:172.21.15.29:6810/3285297772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2160063fd0 con 0x7f21480c0090 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.426+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] conn(0x7f21480c0090 msgr2=0x7f21480c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.426+0000 7f2165d3b640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] conn(0x7f21480c0090 0x7f21480c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f21480b65a0 msgr2=0x7f21480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f21480b65a0 0x7f21480b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2160077160 tx=0x7f2150009530 comp rx=0 tx=0).stop 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2160109e20 msgr2=0x7f2160076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 --2- 172.21.15.29:0/23172632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2160109e20 0x7f2160076190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f215800e970 tx=0x7f215800ed70 comp rx=0 tx=0).stop 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f215ffff640 1 -- 172.21.15.29:0/23172632 reap_dead start 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 shutdown_connections 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 >> 172.21.15.29:0/23172632 conn(0x7f21600ff5e0 msgr2=0x7f2160101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 shutdown_connections 2024-09-21T07:08:31.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:31.427+0000 7f2165d3b640 1 -- 172.21.15.29:0/23172632 wait complete. 2024-09-21T07:08:32.039 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:31 smithi066 ceph-mon[34793]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T07:08:32.039 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:31 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:32.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:31 smithi029 ceph-mon[30983]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T07:08:32.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:31 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:32.160 INFO:teuthology.orchestra.run.smithi029.stdout:103079215170 2024-09-21T07:08:32.160 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T07:08:32.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:31 smithi052 ceph-mon[34308]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-21T07:08:32.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:31 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:08:32.603 INFO:teuthology.orchestra.run.smithi029.stdout:244813135906 2024-09-21T07:08:32.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T07:08:33.267 INFO:teuthology.orchestra.run.smithi029.stdout:146028888120 2024-09-21T07:08:33.267 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T07:08:33.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.068+0000 7f703cd7e640 1 -- 172.21.15.29:0/825306678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 msgr2=0x7f7038103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.068+0000 7f703cd7e640 1 --2- 172.21.15.29:0/825306678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 0x7f7038103f70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7028009900 tx=0x7f702802a410 comp rx=0 tx=0).stop 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 -- 172.21.15.29:0/825306678 shutdown_connections 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 --2- 172.21.15.29:0/825306678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7038109df0 0x7f7038110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 --2- 172.21.15.29:0/825306678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f70381094a0 0x7f70381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 --2- 172.21.15.29:0/825306678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 0x7f7038103f70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 -- 172.21.15.29:0/825306678 >> 172.21.15.29:0/825306678 conn(0x7f703807b850 msgr2=0x7f703807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 -- 172.21.15.29:0/825306678 shutdown_connections 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 -- 172.21.15.29:0/825306678 wait complete. 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 Processor -- start 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.069+0000 7f703cd7e640 1 -- start start 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703cd7e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 0x7f703819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703cd7e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70381094a0 0x7f703819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:33.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703cd7e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038109df0 0x7f703819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703cd7e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7038113b70 con 0x7f7038103b60 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703cd7e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70381139f0 con 0x7f7038109df0 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703cd7e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7038113cf0 con 0x7f70381094a0 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 0x7f703819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 0x7f703819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58864/0 (socket says 172.21.15.29:58864) 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 -- 172.21.15.29:0/1110320671 learned_addr learned my addr 172.21.15.29:0/1110320671 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f7036d9d640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038109df0 0x7f703819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:33.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 -- 172.21.15.29:0/1110320671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70381094a0 msgr2=0x7f703819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f7035d9b640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70381094a0 0x7f703819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70381094a0 0x7f703819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 -- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038109df0 msgr2=0x7f703819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038109df0 0x7f703819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 -- 172.21.15.29:0/1110320671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70381a05b0 con 0x7f7038103b60 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f7036d9d640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038109df0 0x7f703819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.070+0000 7f703659c640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 0x7f703819a640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7028006010 tx=0x7f70280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.071+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702803f030 con 0x7f7038103b60 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.071+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7028003800 con 0x7f7038103b60 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.071+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70381a0840 con 0x7f7038103b60 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.071+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028035070 con 0x7f7038103b60 2024-09-21T07:08:33.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.071+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70381a7000 con 0x7f7038103b60 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.071+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7038063b50 con 0x7f7038103b60 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.073+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f70280039b0 con 0x7f7038103b60 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.074+0000 7f70277fe640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f70200b65a0 0x7f70200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.074+0000 7f7035d9b640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f70200b65a0 0x7f70200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.074+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7028108550 con 0x7f7038103b60 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.074+0000 7f70277fe640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] conn(0x7f70200c0090 0x7f70200c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.074+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 --> [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70200c2c50 con 0x7f70200c0090 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.074+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f70281089a0 con 0x7f7038103b60 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.075+0000 7f7035d9b640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f70200b65a0 0x7f70200b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70381064c0 tx=0x7f702c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.075+0000 7f7036d9d640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] conn(0x7f70200c0090 0x7f70200c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.075+0000 7f7036d9d640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] conn(0x7f70200c0090 0x7f70200c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:33.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.076+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== osd.7 v2:172.21.15.52:6816/4067251695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70200c2c50 con 0x7f70200c0090 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.090+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 --> [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7038063fd0 con 0x7f70200c0090 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.090+0000 7f70277fe640 1 -- 172.21.15.29:0/1110320671 <== osd.7 v2:172.21.15.52:6816/4067251695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7038063fd0 con 0x7f70200c0090 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] conn(0x7f70200c0090 msgr2=0x7f70200c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] conn(0x7f70200c0090 0x7f70200c2580 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f70200b65a0 msgr2=0x7f70200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f70200b65a0 0x7f70200b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70381064c0 tx=0x7f702c008040 comp rx=0 tx=0).stop 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 msgr2=0x7f703819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 --2- 172.21.15.29:0/1110320671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7038103b60 0x7f703819a640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7028006010 tx=0x7f70280042f0 comp rx=0 tx=0).stop 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f7036d9d640 1 -- 172.21.15.29:0/1110320671 reap_dead start 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 shutdown_connections 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 >> 172.21.15.29:0/1110320671 conn(0x7f703807b850 msgr2=0x7f70381076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 shutdown_connections 2024-09-21T07:08:33.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:25.091+0000 7f703cd7e640 1 -- 172.21.15.29:0/1110320671 wait complete. 2024-09-21T07:08:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:33 smithi052 ceph-mon[34308]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-21T07:08:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:33 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:33 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:33 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:33 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.034 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:33 smithi029 ceph-mon[30983]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-21T07:08:34.034 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:33 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.034 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:33 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.034 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:33 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.034 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:33 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.071 INFO:teuthology.orchestra.run.smithi029.stdout:193273528364 2024-09-21T07:08:34.072 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T07:08:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:33 smithi066 ceph-mon[34793]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-09-21T07:08:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:33 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:33 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:33 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:33 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.312+0000 7f8248d5b640 1 -- 172.21.15.29:0/536879620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82441094a0 msgr2=0x7f82441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:34.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.312+0000 7f8248d5b640 1 --2- 172.21.15.29:0/536879620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82441094a0 0x7f82441098b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f822c009900 tx=0x7f822c02a410 comp rx=0 tx=0).stop 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.313+0000 7f8248d5b640 1 -- 172.21.15.29:0/536879620 shutdown_connections 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.313+0000 7f8248d5b640 1 --2- 172.21.15.29:0/536879620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8244109df0 0x7f8244110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.313+0000 7f8248d5b640 1 --2- 172.21.15.29:0/536879620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82441094a0 0x7f82441098b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.313+0000 7f8248d5b640 1 --2- 172.21.15.29:0/536879620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8244103b60 0x7f8244103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.313+0000 7f8248d5b640 1 -- 172.21.15.29:0/536879620 >> 172.21.15.29:0/536879620 conn(0x7f824407b850 msgr2=0x7f824407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.313+0000 7f8248d5b640 1 -- 172.21.15.29:0/536879620 shutdown_connections 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.313+0000 7f8248d5b640 1 -- 172.21.15.29:0/536879620 wait complete. 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 Processor -- start 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 -- start start 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8244103b60 0x7f824419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82441094a0 0x7f824419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8244109df0 0x7f824419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:34.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8244113ad0 con 0x7f8244103b60 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8244113950 con 0x7f8244109df0 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8248d5b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8244113c50 con 0x7f82441094a0 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8244103b60 0x7f824419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8244103b60 0x7f824419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35566/0 (socket says 172.21.15.29:35566) 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 -- 172.21.15.29:0/1098553578 learned_addr learned my addr 172.21.15.29:0/1098553578 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8241d9b640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82441094a0 0x7f824419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f8242d9d640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8244109df0 0x7f824419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 -- 172.21.15.29:0/1098553578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82441094a0 msgr2=0x7f824419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82441094a0 0x7f824419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 -- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8244109df0 msgr2=0x7f824419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8244109df0 0x7f824419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:34.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.314+0000 7f824259c640 1 -- 172.21.15.29:0/1098553578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82441a0430 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.315+0000 7f824259c640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8244103b60 0x7f824419a4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f823400d950 tx=0x7f823400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.315+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234017030 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.315+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82441a0720 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.315+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8234004020 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.315+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340047a0 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.315+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82441a6e80 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.316+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8244063ad0 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.318+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8234009a30 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.318+0000 7f823b7fe640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f82300b65a0 0x7f82300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.319+0000 7f8241d9b640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f82300b65a0 0x7f82300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.319+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f82340e7a50 con 0x7f8244103b60 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.319+0000 7f823b7fe640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] conn(0x7f82300c0090 0x7f82300c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:34.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.319+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 --> [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f823401fe50 con 0x7f82300c0090 2024-09-21T07:08:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.319+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f82340e7ea0 con 0x7f8244103b60 2024-09-21T07:08:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.319+0000 7f8241d9b640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f82300b65a0 0x7f82300b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f822c009230 tx=0x7f822c031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.319+0000 7f8242d9d640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] conn(0x7f82300c0090 0x7f82300c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.320+0000 7f8242d9d640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] conn(0x7f82300c0090 0x7f82300c2580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.320+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== osd.4 v2:172.21.15.52:6808/189683591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f823401fe50 con 0x7f82300c0090 2024-09-21T07:08:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.334+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 --> [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8244063f00 con 0x7f82300c0090 2024-09-21T07:08:34.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.334+0000 7f823b7fe640 1 -- 172.21.15.29:0/1098553578 <== osd.4 v2:172.21.15.52:6808/189683591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8244063f00 con 0x7f82300c0090 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] conn(0x7f82300c0090 msgr2=0x7f82300c2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] conn(0x7f82300c0090 0x7f82300c2580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f82300b65a0 msgr2=0x7f82300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f82300b65a0 0x7f82300b8ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f822c009230 tx=0x7f822c031400 comp rx=0 tx=0).stop 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8244103b60 msgr2=0x7f824419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 --2- 172.21.15.29:0/1098553578 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8244103b60 0x7f824419a4c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f823400d950 tx=0x7f823400de10 comp rx=0 tx=0).stop 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8242d9d640 1 -- 172.21.15.29:0/1098553578 reap_dead start 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 shutdown_connections 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 >> 172.21.15.29:0/1098553578 conn(0x7f824407b850 msgr2=0x7f8244107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 shutdown_connections 2024-09-21T07:08:34.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:34.335+0000 7f8248d5b640 1 -- 172.21.15.29:0/1098553578 wait complete. 2024-09-21T07:08:35.079 INFO:teuthology.orchestra.run.smithi029.stdout:128849018941 2024-09-21T07:08:35.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T07:08:35.091 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:35.091 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:35.097 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:35.100 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:35.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.882+0000 7efe3bd48640 1 -- 172.21.15.29:0/945057292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 msgr2=0x7efe3410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.882+0000 7efe3bd48640 1 --2- 172.21.15.29:0/945057292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3410f520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009ca0 tx=0x7efe2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.882+0000 7efe3bd48640 1 -- 172.21.15.29:0/945057292 shutdown_connections 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.882+0000 7efe3bd48640 1 --2- 172.21.15.29:0/945057292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3410f520 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.882+0000 7efe3bd48640 1 --2- 172.21.15.29:0/945057292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe341083a0 0x7efe341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.882+0000 7efe3bd48640 1 --2- 172.21.15.29:0/945057292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe34102a60 0x7efe34102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.882+0000 7efe3bd48640 1 -- 172.21.15.29:0/945057292 >> 172.21.15.29:0/945057292 conn(0x7efe34079730 msgr2=0x7efe34079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.883+0000 7efe3bd48640 1 -- 172.21.15.29:0/945057292 shutdown_connections 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.883+0000 7efe3bd48640 1 -- 172.21.15.29:0/945057292 wait complete. 2024-09-21T07:08:35.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.883+0000 7efe3bd48640 1 Processor -- start 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.883+0000 7efe3bd48640 1 -- start start 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3bd48640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe34102a60 0x7efe3419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3bd48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe341083a0 0x7efe3419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3bd48640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3bd48640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efe34113a70 con 0x7efe34108cf0 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3bd48640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe341138f0 con 0x7efe341083a0 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3bd48640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe34113bf0 con 0x7efe34102a60 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35574/0 (socket says 172.21.15.29:35574) 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 -- 172.21.15.29:0/2369136077 learned_addr learned my addr 172.21.15.29:0/2369136077 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe392e3640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe341083a0 0x7efe3419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe39ae4640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe34102a60 0x7efe3419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 -- 172.21.15.29:0/2369136077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe34102a60 msgr2=0x7efe3419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe34102a60 0x7efe3419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 -- 172.21.15.29:0/2369136077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe341083a0 msgr2=0x7efe3419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe341083a0 0x7efe3419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 -- 172.21.15.29:0/2369136077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe341a0390 con 0x7efe34108cf0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.884+0000 7efe3a2e5640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3419fc60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe2c005cc0 tx=0x7efe2c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.885+0000 7efe2affd640 1 -- 172.21.15.29:0/2369136077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c003cf0 con 0x7efe34108cf0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.885+0000 7efe2affd640 1 -- 172.21.15.29:0/2369136077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe2c0044f0 con 0x7efe34108cf0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.885+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe341a0620 con 0x7efe34108cf0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.885+0000 7efe2affd640 1 -- 172.21.15.29:0/2369136077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c02fd10 con 0x7efe34108cf0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.885+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe341a6de0 con 0x7efe34108cf0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.886+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe34102e70 con 0x7efe34108cf0 2024-09-21T07:08:35.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.887+0000 7efe2affd640 1 -- 172.21.15.29:0/2369136077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7efe2c004040 con 0x7efe34108cf0 2024-09-21T07:08:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.889+0000 7efe2affd640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7efe200b65a0 0x7efe200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.889+0000 7efe39ae4640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7efe200b65a0 0x7efe200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.889+0000 7efe2affd640 1 -- 172.21.15.29:0/2369136077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7efe2c108c50 con 0x7efe34108cf0 2024-09-21T07:08:35.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.889+0000 7efe39ae4640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7efe200b65a0 0x7efe200b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe30005fd0 tx=0x7efe30005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:35.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:35.892+0000 7efe2affd640 1 -- 172.21.15.29:0/2369136077 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe2c0cf390 con 0x7efe34108cf0 2024-09-21T07:08:35.905 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:35.905 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:35 smithi052 ceph-mon[34308]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8 op/s 2024-09-21T07:08:36.008 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:35 smithi029 ceph-mon[30983]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8 op/s 2024-09-21T07:08:36.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:35 smithi066 ceph-mon[34793]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8 op/s 2024-09-21T07:08:36.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.099+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efe3419b550 con 0x7efe34108cf0 2024-09-21T07:08:36.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.100+0000 7efe2affd640 1 -- 172.21.15.29:0/2369136077 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7efe3419b550 con 0x7efe34108cf0 2024-09-21T07:08:36.102 INFO:teuthology.orchestra.run.smithi029.stdout:266287972382 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7efe200b65a0 msgr2=0x7efe200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7efe200b65a0 0x7efe200b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efe30005fd0 tx=0x7efe30005e20 comp rx=0 tx=0).stop 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 msgr2=0x7efe3419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3419fc60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe2c005cc0 tx=0x7efe2c02f470 comp rx=0 tx=0).stop 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 shutdown_connections 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7efe200b65a0 0x7efe200b8ab0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe34108cf0 0x7efe3419fc60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe341083a0 0x7efe3419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 --2- 172.21.15.29:0/2369136077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe34102a60 0x7efe3419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 >> 172.21.15.29:0/2369136077 conn(0x7efe34079730 msgr2=0x7efe341043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 shutdown_connections 2024-09-21T07:08:36.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:36.102+0000 7efe3bd48640 1 -- 172.21.15.29:0/2369136077 wait complete. 2024-09-21T07:08:36.850 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972380 got 266287972382 for osd.10 2024-09-21T07:08:36.850 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:36.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:36 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2369136077' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:08:37.080 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:36 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2369136077' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:08:37.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:36 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2369136077' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 -- 172.21.15.29:0/1436253442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c1094a0 msgr2=0x7ff87c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:37.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 --2- 172.21.15.29:0/1436253442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c1094a0 0x7ff87c1098b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff870009900 tx=0x7ff87002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 -- 172.21.15.29:0/1436253442 shutdown_connections 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 --2- 172.21.15.29:0/1436253442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff87c109df0 0x7ff87c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 --2- 172.21.15.29:0/1436253442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c1094a0 0x7ff87c1098b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 --2- 172.21.15.29:0/1436253442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c103b60 0x7ff87c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 -- 172.21.15.29:0/1436253442 >> 172.21.15.29:0/1436253442 conn(0x7ff87c07b850 msgr2=0x7ff87c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 -- 172.21.15.29:0/1436253442 shutdown_connections 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.416+0000 7ff880fa9640 1 -- 172.21.15.29:0/1436253442 wait complete. 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 Processor -- start 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 -- start start 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c103b60 0x7ff87c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff87c1094a0 0x7ff87c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:37.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c109df0 0x7ff87c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c113ab0 con 0x7ff87c103b60 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c113930 con 0x7ff87c109df0 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff880fa9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff87c113c30 con 0x7ff87c1094a0 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff87a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c103b60 0x7ff87c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff87a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c103b60 0x7ff87c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44126/0 (socket says 172.21.15.29:44126) 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff87a59c640 1 -- 172.21.15.29:0/467423347 learned_addr learned my addr 172.21.15.29:0/467423347 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.417+0000 7ff879d9b640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff87c1094a0 0x7ff87c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87ad9d640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c109df0 0x7ff87c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87a59c640 1 -- 172.21.15.29:0/467423347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff87c1094a0 msgr2=0x7ff87c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87a59c640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff87c1094a0 0x7ff87c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87a59c640 1 -- 172.21.15.29:0/467423347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c109df0 msgr2=0x7ff87c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87a59c640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c109df0 0x7ff87c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87a59c640 1 -- 172.21.15.29:0/467423347 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87c1a0410 con 0x7ff87c103b60 2024-09-21T07:08:37.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87ad9d640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c109df0 0x7ff87c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff87a59c640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c103b60 0x7ff87c19a4a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00d950 tx=0x7ff86c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff86b7fe640 1 -- 172.21.15.29:0/467423347 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c017070 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff87c1a0700 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff86b7fe640 1 -- 172.21.15.29:0/467423347 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff86c009c30 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff86b7fe640 1 -- 172.21.15.29:0/467423347 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00f620 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.418+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff87c1a6e60 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.419+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c103f70 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.421+0000 7ff86b7fe640 1 -- 172.21.15.29:0/467423347 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff86c005030 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.421+0000 7ff86b7fe640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8640b65a0 0x7ff8640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.422+0000 7ff879d9b640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8640b65a0 0x7ff8640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.422+0000 7ff86b7fe640 1 -- 172.21.15.29:0/467423347 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff86c0e7090 con 0x7ff87c103b60 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.422+0000 7ff879d9b640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8640b65a0 0x7ff8640b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff870009230 tx=0x7ff870031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.425+0000 7ff86b7fe640 1 -- 172.21.15.29:0/467423347 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff86c0ad7d0 con 0x7ff87c103b60 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.631+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff87c19b5d0 con 0x7ff87c103b60 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.631+0000 7ff86b7fe640 1 -- 172.21.15.29:0/467423347 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff86c009de0 con 0x7ff87c103b60 2024-09-21T07:08:37.633 INFO:teuthology.orchestra.run.smithi029.stdout:219043332137 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8640b65a0 msgr2=0x7ff8640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8640b65a0 0x7ff8640b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff870009230 tx=0x7ff870031400 comp rx=0 tx=0).stop 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c103b60 msgr2=0x7ff87c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c103b60 0x7ff87c19a4a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00d950 tx=0x7ff86c00de10 comp rx=0 tx=0).stop 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 shutdown_connections 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8640b65a0 0x7ff8640b8ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff87c109df0 0x7ff87c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff87c1094a0 0x7ff87c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 --2- 172.21.15.29:0/467423347 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff87c103b60 0x7ff87c19a4a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:37.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 >> 172.21.15.29:0/467423347 conn(0x7ff87c07b850 msgr2=0x7ff87c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 shutdown_connections 2024-09-21T07:08:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.634+0000 7ff880fa9640 1 -- 172.21.15.29:0/467423347 wait complete. 2024-09-21T07:08:37.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:37 smithi052 ceph-mon[34308]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T07:08:37.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:37 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/467423347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:08:38.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:37 smithi066 ceph-mon[34793]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T07:08:38.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:37 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/467423347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:08:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:37 smithi029 ceph-mon[30983]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-21T07:08:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:37 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/467423347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 -- 172.21.15.29:0/3583028860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c104840 msgr2=0x7f139c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 --2- 172.21.15.29:0/3583028860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c104840 0x7f139c104c50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f138c009900 tx=0x7f138c02a410 comp rx=0 tx=0).stop 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 -- 172.21.15.29:0/3583028860 shutdown_connections 2024-09-21T07:08:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 --2- 172.21.15.29:0/3583028860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f139c10ddf0 0x7f139c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 --2- 172.21.15.29:0/3583028860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c105270 0x7f139c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 --2- 172.21.15.29:0/3583028860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c104840 0x7f139c104c50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 -- 172.21.15.29:0/3583028860 >> 172.21.15.29:0/3583028860 conn(0x7f139c079730 msgr2=0x7f139c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 -- 172.21.15.29:0/3583028860 shutdown_connections 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.964+0000 7f13a18ad640 1 -- 172.21.15.29:0/3583028860 wait complete. 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.965+0000 7f13a18ad640 1 Processor -- start 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.965+0000 7f13a18ad640 1 -- start start 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f13a18ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f139c104840 0x7f139c102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f13a18ad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c105270 0x7f139c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f13a18ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c10ddf0 0x7f139c1031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f13a18ad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f139c113a90 con 0x7f139c105270 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f13a18ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f139c113910 con 0x7f139c10ddf0 2024-09-21T07:08:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f13a18ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f139c113c10 con 0x7f139c104840 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c105270 0x7f139c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c105270 0x7f139c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44132/0 (socket says 172.21.15.29:44132) 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 -- 172.21.15.29:0/2468661355 learned_addr learned my addr 172.21.15.29:0/2468661355 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f139affd640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f139c104840 0x7f139c102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f139b7fe640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c10ddf0 0x7f139c1031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 -- 172.21.15.29:0/2468661355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f139c104840 msgr2=0x7f139c102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f139c104840 0x7f139c102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 -- 172.21.15.29:0/2468661355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c10ddf0 msgr2=0x7f139c1031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c10ddf0 0x7f139c1031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 -- 172.21.15.29:0/2468661355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c1a8690 con 0x7f139c105270 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f139affd640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f139c104840 0x7f139c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f1393fff640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c105270 0x7f139c102c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f138400c8c0 tx=0x7f138400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.966+0000 7f13a08ab640 1 -- 172.21.15.29:0/2468661355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384007bb0 con 0x7f139c105270 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.967+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c1a8980 con 0x7f139c105270 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.967+0000 7f13a08ab640 1 -- 172.21.15.29:0/2468661355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1384007d50 con 0x7f139c105270 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.967+0000 7f13a08ab640 1 -- 172.21.15.29:0/2468661355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13840187c0 con 0x7f139c105270 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.967+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c1a8ec0 con 0x7f139c105270 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.968+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f139c104c50 con 0x7f139c105270 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.969+0000 7f13a08ab640 1 -- 172.21.15.29:0/2468661355 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f138400fa20 con 0x7f139c105270 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.970+0000 7f13a08ab640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f13880b65a0 0x7f13880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.231 INFO:teuthology.orchestra.run.smithi029.stdout:287762808858 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.970+0000 7f139affd640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f13880b65a0 0x7f13880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.970+0000 7f13a08ab640 1 -- 172.21.15.29:0/2468661355 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f13840e7920 con 0x7f139c105270 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.971+0000 7f139affd640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f13880b65a0 0x7f13880b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f138c009230 tx=0x7f138c032da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:37.973+0000 7f13a08ab640 1 -- 172.21.15.29:0/2468661355 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1384014030 con 0x7f139c105270 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.162+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f139c103a50 con 0x7f139c105270 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.163+0000 7f13a08ab640 1 -- 172.21.15.29:0/2468661355 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f13840ae0f0 con 0x7f139c105270 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f13880b65a0 msgr2=0x7f13880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f13880b65a0 0x7f13880b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f138c009230 tx=0x7f138c032da0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c105270 msgr2=0x7f139c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c105270 0x7f139c102c90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f138400c8c0 tx=0x7f138400cd80 comp rx=0 tx=0).stop 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 shutdown_connections 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f13880b65a0 0x7f13880b8ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f139c10ddf0 0x7f139c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f139c105270 0x7f139c102c90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 --2- 172.21.15.29:0/2468661355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f139c104840 0x7f139c102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 >> 172.21.15.29:0/2468661355 conn(0x7f139c079730 msgr2=0x7f139c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 shutdown_connections 2024-09-21T07:08:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.165+0000 7f13a18ad640 1 -- 172.21.15.29:0/2468661355 wait complete. 2024-09-21T07:08:38.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:38 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2468661355' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 -- 172.21.15.29:0/762925587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c105380 msgr2=0x7f3a8c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 --2- 172.21.15.29:0/762925587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c105380 0x7f3a8c10d8d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009900 tx=0x7f3a7402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 -- 172.21.15.29:0/762925587 shutdown_connections 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 --2- 172.21.15.29:0/762925587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8c10de60 0x7f3a8c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 --2- 172.21.15.29:0/762925587 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c105380 0x7f3a8c10d8d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 --2- 172.21.15.29:0/762925587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a8c104a30 0x7f3a8c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 -- 172.21.15.29:0/762925587 >> 172.21.15.29:0/762925587 conn(0x7f3a8c079760 msgr2=0x7f3a8c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 -- 172.21.15.29:0/762925587 shutdown_connections 2024-09-21T07:08:38.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.917+0000 7f3a92a06640 1 -- 172.21.15.29:0/762925587 wait complete. 2024-09-21T07:08:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 Processor -- start 2024-09-21T07:08:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 -- start start 2024-09-21T07:08:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a8c104a30 0x7f3a8c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8c105380 0x7f3a8c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c10de60 0x7f3a8c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c113af0 con 0x7f3a8c10de60 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c113970 con 0x7f3a8c105380 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a92a06640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c113c70 con 0x7f3a8c104a30 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a90fa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c10de60 0x7f3a8c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a90fa3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c10de60 0x7f3a8c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44154/0 (socket says 172.21.15.29:44154) 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a90fa3640 1 -- 172.21.15.29:0/3574081327 learned_addr learned my addr 172.21.15.29:0/3574081327 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a8bfff640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a8c104a30 0x7f3a8c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.918+0000 7f3a83fff640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8c105380 0x7f3a8c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a90fa3640 1 -- 172.21.15.29:0/3574081327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a8c104a30 msgr2=0x7f3a8c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a90fa3640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a8c104a30 0x7f3a8c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a90fa3640 1 -- 172.21.15.29:0/3574081327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8c105380 msgr2=0x7f3a8c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a90fa3640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8c105380 0x7f3a8c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a90fa3640 1 -- 172.21.15.29:0/3574081327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c1a0410 con 0x7f3a8c10de60 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a8bfff640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a8c104a30 0x7f3a8c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a90fa3640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c10de60 0x7f3a8c19fce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009fd0 tx=0x7f3a8400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a89ffb640 1 -- 172.21.15.29:0/3574081327 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84017070 con 0x7f3a8c10de60 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a89ffb640 1 -- 172.21.15.29:0/3574081327 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a84003e20 con 0x7f3a8c10de60 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8c1a0700 con 0x7f3a8c10de60 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a89ffb640 1 -- 172.21.15.29:0/3574081327 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84010460 con 0x7f3a8c10de60 2024-09-21T07:08:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.919+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8c1a6e60 con 0x7f3a8c10de60 2024-09-21T07:08:38.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.920+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8c06c1f0 con 0x7f3a8c10de60 2024-09-21T07:08:38.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.922+0000 7f3a89ffb640 1 -- 172.21.15.29:0/3574081327 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3a84003970 con 0x7f3a8c10de60 2024-09-21T07:08:38.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.923+0000 7f3a89ffb640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3a780b65a0 0x7f3a780b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:38.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.923+0000 7f3a8bfff640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3a780b65a0 0x7f3a780b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:38.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.923+0000 7f3a89ffb640 1 -- 172.21.15.29:0/3574081327 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3a840e7330 con 0x7f3a8c10de60 2024-09-21T07:08:38.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.923+0000 7f3a8bfff640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3a780b65a0 0x7f3a780b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c06c8f0 tx=0x7f3a7c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:38.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:38.927+0000 7f3a89ffb640 1 -- 172.21.15.29:0/3574081327 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a840ada10 con 0x7f3a8c10de60 2024-09-21T07:08:39.002 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:38 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2468661355' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.119+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3a8c108f40 con 0x7f3a8c10de60 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.119+0000 7f3a89ffb640 1 -- 172.21.15.29:0/3574081327 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a840b1df0 con 0x7f3a8c10de60 2024-09-21T07:08:39.121 INFO:teuthology.orchestra.run.smithi029.stdout:77309411401 2024-09-21T07:08:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.121+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3a780b65a0 msgr2=0x7f3a780b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3a780b65a0 0x7f3a780b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c06c8f0 tx=0x7f3a7c005f90 comp rx=0 tx=0).stop 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c10de60 msgr2=0x7f3a8c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c10de60 0x7f3a8c19fce0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009fd0 tx=0x7f3a8400b260 comp rx=0 tx=0).stop 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 shutdown_connections 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3a780b65a0 0x7f3a780b8ab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3a8c10de60 0x7f3a8c19fce0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8c105380 0x7f3a8c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 --2- 172.21.15.29:0/3574081327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a8c104a30 0x7f3a8c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 >> 172.21.15.29:0/3574081327 conn(0x7f3a8c079760 msgr2=0x7f3a8c100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 shutdown_connections 2024-09-21T07:08:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:39.122+0000 7f3a92a06640 1 -- 172.21.15.29:0/3574081327 wait complete. 2024-09-21T07:08:39.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:38 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2468661355' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T07:08:39.406 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332135 got 219043332137 for osd.8 2024-09-21T07:08:39.406 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:39.837 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808857 got 287762808858 for osd.11 2024-09-21T07:08:39.837 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:40.063 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:39 smithi029 ceph-mon[30983]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:08:40.064 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:39 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3574081327' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:08:40.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:39 smithi066 ceph-mon[34793]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:08:40.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:39 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3574081327' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:08:40.143 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:39 smithi052 ceph-mon[34308]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:08:40.143 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:39 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3574081327' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T07:08:40.288 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:40.288 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:40.878 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411398 got 77309411401 for osd.2 2024-09-21T07:08:40.879 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:41.877 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:41 smithi029 ceph-mon[30983]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:08:42.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:41 smithi066 ceph-mon[34793]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:08:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 -- 172.21.15.29:0/2476822927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0741083a0 msgr2=0x7fd0741087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 --2- 172.21.15.29:0/2476822927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0741083a0 0x7fd0741087b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd068009900 tx=0x7fd06802a410 comp rx=0 tx=0).stop 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 -- 172.21.15.29:0/2476822927 shutdown_connections 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 --2- 172.21.15.29:0/2476822927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd074108cf0 0x7fd07410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 --2- 172.21.15.29:0/2476822927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0741083a0 0x7fd0741087b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 --2- 172.21.15.29:0/2476822927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd074102a60 0x7fd074102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 -- 172.21.15.29:0/2476822927 >> 172.21.15.29:0/2476822927 conn(0x7fd074079730 msgr2=0x7fd074079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 -- 172.21.15.29:0/2476822927 shutdown_connections 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.089+0000 7fd078f73640 1 -- 172.21.15.29:0/2476822927 wait complete. 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 Processor -- start 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 -- start start 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd074102a60 0x7fd07419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0741083a0 0x7fd07419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd074108cf0 0x7fd07419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd074112960 con 0x7fd074102a60 2024-09-21T07:08:42.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd0741127e0 con 0x7fd074108cf0 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd078f73640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd074112ae0 con 0x7fd0741083a0 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd07259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd074102a60 0x7fd07419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd07259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd074102a60 0x7fd07419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44180/0 (socket says 172.21.15.29:44180) 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.090+0000 7fd07259c640 1 -- 172.21.15.29:0/2667707979 learned_addr learned my addr 172.21.15.29:0/2667707979 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd072d9d640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd074108cf0 0x7fd07419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd071d9b640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0741083a0 0x7fd07419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd07259c640 1 -- 172.21.15.29:0/2667707979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0741083a0 msgr2=0x7fd07419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd07259c640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0741083a0 0x7fd07419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd07259c640 1 -- 172.21.15.29:0/2667707979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd074108cf0 msgr2=0x7fd07419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd07259c640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd074108cf0 0x7fd07419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd07259c640 1 -- 172.21.15.29:0/2667707979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0741a0430 con 0x7fd074102a60 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd07259c640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd074102a60 0x7fd07419a4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd06400c890 tx=0x7fd06400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:42.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd0637fe640 1 -- 172.21.15.29:0/2667707979 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064004220 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd0637fe640 1 -- 172.21.15.29:0/2667707979 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0640043c0 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0741a0720 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd0637fe640 1 -- 172.21.15.29:0/2667707979 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064004a00 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.091+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0741a6e80 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.093+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd074102e70 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.094+0000 7fd0637fe640 1 -- 172.21.15.29:0/2667707979 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd0640079b0 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.094+0000 7fd0637fe640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd05c0b6620 0x7fd05c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.095+0000 7fd071d9b640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd05c0b6620 0x7fd05c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.095+0000 7fd0637fe640 1 -- 172.21.15.29:0/2667707979 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd0640e70e0 con 0x7fd074102a60 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.095+0000 7fd071d9b640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd05c0b6620 0x7fd05c0b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd068000c00 tx=0x7fd068031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:42.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.099+0000 7fd0637fe640 1 -- 172.21.15.29:0/2667707979 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd064014030 con 0x7fd074102a60 2024-09-21T07:08:42.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 -- 172.21.15.29:0/2222194833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 msgr2=0x7f8fe8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 --2- 172.21.15.29:0/2222194833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe8103f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009900 tx=0x7f8fe002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 -- 172.21.15.29:0/2222194833 shutdown_connections 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 --2- 172.21.15.29:0/2222194833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe8109e10 0x7f8fe8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 --2- 172.21.15.29:0/2222194833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe81094c0 0x7f8fe81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 --2- 172.21.15.29:0/2222194833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe8103f90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 -- 172.21.15.29:0/2222194833 >> 172.21.15.29:0/2222194833 conn(0x7f8fe80ff610 msgr2=0x7f8fe8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 -- 172.21.15.29:0/2222194833 shutdown_connections 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 -- 172.21.15.29:0/2222194833 wait complete. 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.969+0000 7f8fed609640 1 Processor -- start 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fed609640 1 -- start start 2024-09-21T07:08:42.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fed609640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fed609640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe81094c0 0x7f8fe819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fed609640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe8109e10 0x7f8fe819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fed609640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8113b10 con 0x7f8fe8103b80 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fed609640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8113990 con 0x7f8fe81094c0 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fed609640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8113c90 con 0x7f8fe8109e10 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44166/0 (socket says 172.21.15.29:44166) 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 -- 172.21.15.29:0/1806751792 learned_addr learned my addr 172.21.15.29:0/1806751792 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe67fc640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe81094c0 0x7f8fe819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe77fe640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe8109e10 0x7f8fe819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 -- 172.21.15.29:0/1806751792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe8109e10 msgr2=0x7f8fe819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe8109e10 0x7f8fe819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 -- 172.21.15.29:0/1806751792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe81094c0 msgr2=0x7f8fe819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe81094c0 0x7f8fe819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe6ffd640 1 -- 172.21.15.29:0/1806751792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe81a0490 con 0x7f8fe8103b80 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.970+0000 7f8fe67fc640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe81094c0 0x7f8fe819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.971+0000 7f8fe6ffd640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe819a520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0006010 tx=0x7f8fe00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stdout:146028888121 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.971+0000 7f8fdffff640 1 -- 172.21.15.29:0/1806751792 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe003f030 con 0x7f8fe8103b80 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.971+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe81a0720 con 0x7f8fe8103b80 2024-09-21T07:08:42.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.971+0000 7f8fdffff640 1 -- 172.21.15.29:0/1806751792 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe0003800 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.971+0000 7f8fdffff640 1 -- 172.21.15.29:0/1806751792 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0035070 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.971+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe81a6ee0 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.972+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe8103f90 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.974+0000 7f8fdffff640 1 -- 172.21.15.29:0/1806751792 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8fe00039b0 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.974+0000 7f8fdffff640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fd40b65a0 0x7f8fd40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.975+0000 7f8fe67fc640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fd40b65a0 0x7f8fd40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.975+0000 7f8fdffff640 1 -- 172.21.15.29:0/1806751792 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8fe01080c0 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.975+0000 7f8fe67fc640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fd40b65a0 0x7f8fd40b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8108e80 tx=0x7f8fd0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:41.978+0000 7f8fdffff640 1 -- 172.21.15.29:0/1806751792 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fe00ce800 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.172+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8fe802e640 con 0x7f8fe8103b80 2024-09-21T07:08:42.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.172+0000 7f8fdffff640 1 -- 172.21.15.29:0/1806751792 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8fe00d2be0 con 0x7f8fe8103b80 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fd40b65a0 msgr2=0x7f8fd40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fd40b65a0 0x7f8fd40b8ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8108e80 tx=0x7f8fd0008040 comp rx=0 tx=0).stop 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 msgr2=0x7f8fe819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe819a520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0006010 tx=0x7f8fe00042f0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 shutdown_connections 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fd40b65a0 0x7f8fd40b8ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe8109e10 0x7f8fe819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe81094c0 0x7f8fe819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 --2- 172.21.15.29:0/1806751792 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe8103b80 0x7f8fe819a520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 >> 172.21.15.29:0/1806751792 conn(0x7f8fe80ff610 msgr2=0x7f8fe8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 shutdown_connections 2024-09-21T07:08:42.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.175+0000 7f8fed609640 1 -- 172.21.15.29:0/1806751792 wait complete. 2024-09-21T07:08:42.242 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:41 smithi052 ceph-mon[34308]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-21T07:08:42.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.292+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd07419b5f0 con 0x7fd074102a60 2024-09-21T07:08:42.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.292+0000 7fd0637fe640 1 -- 172.21.15.29:0/2667707979 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd0640b1c00 con 0x7fd074102a60 2024-09-21T07:08:42.294 INFO:teuthology.orchestra.run.smithi029.stdout:171798691892 2024-09-21T07:08:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd05c0b6620 msgr2=0x7fd05c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd05c0b6620 0x7fd05c0b8b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd068000c00 tx=0x7fd068031400 comp rx=0 tx=0).stop 2024-09-21T07:08:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd074102a60 msgr2=0x7fd07419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd074102a60 0x7fd07419a4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd06400c890 tx=0x7fd06400cd50 comp rx=0 tx=0).stop 2024-09-21T07:08:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 shutdown_connections 2024-09-21T07:08:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd05c0b6620 0x7fd05c0b8b30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd074108cf0 0x7fd07419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0741083a0 0x7fd07419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 --2- 172.21.15.29:0/2667707979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd074102a60 0x7fd07419a4c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.294+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 >> 172.21.15.29:0/2667707979 conn(0x7fd074079730 msgr2=0x7fd07406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.295+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 shutdown_connections 2024-09-21T07:08:42.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:42.295+0000 7fd078f73640 1 -- 172.21.15.29:0/2667707979 wait complete. 2024-09-21T07:08:42.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:42 smithi029 ceph-mon[30983]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T07:08:42.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:42 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1806751792' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:08:42.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:42 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2667707979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:08:43.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:42 smithi066 ceph-mon[34793]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T07:08:43.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:42 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1806751792' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:08:43.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:42 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2667707979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:08:43.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:42 smithi052 ceph-mon[34308]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-21T07:08:43.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:42 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1806751792' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T07:08:43.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:42 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2667707979' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T07:08:43.271 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691890 got 171798691892 for osd.6 2024-09-21T07:08:43.271 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 -- 172.21.15.29:0/3858169052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c108cf0 msgr2=0x7f8a0c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 --2- 172.21.15.29:0/3858169052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c108cf0 0x7f8a0c10f520 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009ca0 tx=0x7f8a0402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 -- 172.21.15.29:0/3858169052 shutdown_connections 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 --2- 172.21.15.29:0/3858169052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c108cf0 0x7f8a0c10f520 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 --2- 172.21.15.29:0/3858169052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a0c1083a0 0x7f8a0c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 --2- 172.21.15.29:0/3858169052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a0c102a60 0x7f8a0c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 -- 172.21.15.29:0/3858169052 >> 172.21.15.29:0/3858169052 conn(0x7f8a0c079730 msgr2=0x7f8a0c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.608+0000 7f8a11951640 1 -- 172.21.15.29:0/3858169052 shutdown_connections 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.609+0000 7f8a11951640 1 -- 172.21.15.29:0/3858169052 wait complete. 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.609+0000 7f8a11951640 1 Processor -- start 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a11951640 1 -- start start 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a11951640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c102a60 0x7f8a0c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:43.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a11951640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a0c1083a0 0x7f8a0c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a11951640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a0c108cf0 0x7f8a0c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a11951640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c112960 con 0x7f8a0c102a60 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a11951640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c1127e0 con 0x7f8a0c108cf0 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a11951640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c112ae0 con 0x7f8a0c1083a0 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a0affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c102a60 0x7f8a0c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a0affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c102a60 0x7f8a0c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44216/0 (socket says 172.21.15.29:44216) 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a0affd640 1 -- 172.21.15.29:0/3333113749 learned_addr learned my addr 172.21.15.29:0/3333113749 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a0b7fe640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a0c108cf0 0x7f8a0c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.610+0000 7f8a0a7fc640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a0c1083a0 0x7f8a0c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a0affd640 1 -- 172.21.15.29:0/3333113749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a0c1083a0 msgr2=0x7f8a0c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a0affd640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a0c1083a0 0x7f8a0c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a0affd640 1 -- 172.21.15.29:0/3333113749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a0c108cf0 msgr2=0x7f8a0c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a0affd640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a0c108cf0 0x7f8a0c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a0affd640 1 -- 172.21.15.29:0/3333113749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c19f260 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a0affd640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c102a60 0x7f8a0c1992f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00e9f0 tx=0x7f89fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a1094f640 1 -- 172.21.15.29:0/3333113749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00cd80 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a1094f640 1 -- 172.21.15.29:0/3333113749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89fc0108e0 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a1094f640 1 -- 172.21.15.29:0/3333113749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc018980 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c19f550 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.611+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c06ae60 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.612+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c102e70 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.614+0000 7f8a1094f640 1 -- 172.21.15.29:0/3333113749 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f89fc010430 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.615+0000 7f8a1094f640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f89f40b65a0 0x7f89f40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.615+0000 7f8a0a7fc640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f89f40b65a0 0x7f89f40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.615+0000 7f8a1094f640 1 -- 172.21.15.29:0/3333113749 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f89fc0e7ca0 con 0x7f8a0c102a60 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.616+0000 7f8a0a7fc640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f89f40b65a0 0x7f89f40b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c105e90 tx=0x7f8a0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:43.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.618+0000 7f8a1094f640 1 -- 172.21.15.29:0/3333113749 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89fc0b27c0 con 0x7f8a0c102a60 2024-09-21T07:08:43.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.813+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8a0c06b950 con 0x7f8a0c102a60 2024-09-21T07:08:43.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.813+0000 7f8a1094f640 1 -- 172.21.15.29:0/3333113749 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f89fc0b7700 con 0x7f8a0c102a60 2024-09-21T07:08:43.815 INFO:teuthology.orchestra.run.smithi029.stdout:193273528368 2024-09-21T07:08:43.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f89f40b65a0 msgr2=0x7f89f40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:43.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f89f40b65a0 0x7f89f40b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c105e90 tx=0x7f8a0000b410 comp rx=0 tx=0).stop 2024-09-21T07:08:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c102a60 msgr2=0x7f8a0c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c102a60 0x7f8a0c1992f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00e9f0 tx=0x7f89fc00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 shutdown_connections 2024-09-21T07:08:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f89f40b65a0 0x7f89f40b8ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a0c108cf0 0x7f8a0c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a0c1083a0 0x7f8a0c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 --2- 172.21.15.29:0/3333113749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a0c102a60 0x7f8a0c1992f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:43.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.815+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 >> 172.21.15.29:0/3333113749 conn(0x7f8a0c079730 msgr2=0x7f8a0c104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:43.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.816+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 shutdown_connections 2024-09-21T07:08:43.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.816+0000 7f8a11951640 1 -- 172.21.15.29:0/3333113749 wait complete. 2024-09-21T07:08:44.081 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:43 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3513956984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:08:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:43 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3513956984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:08:44.114 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888120 got 146028888121 for osd.5 2024-09-21T07:08:44.114 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:44.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:43 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3513956984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.489+0000 7f02475a7640 1 -- 172.21.15.29:0/2532989844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0240108d00 msgr2=0x7f024010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.489+0000 7f02475a7640 1 --2- 172.21.15.29:0/2532989844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0240108d00 0x7f024010f530 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0238009ca0 tx=0x7f023802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.489+0000 7f02475a7640 1 -- 172.21.15.29:0/2532989844 shutdown_connections 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.489+0000 7f02475a7640 1 --2- 172.21.15.29:0/2532989844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0240108d00 0x7f024010f530 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.489+0000 7f02475a7640 1 --2- 172.21.15.29:0/2532989844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02401083b0 0x7f02401087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.489+0000 7f02475a7640 1 --2- 172.21.15.29:0/2532989844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0240102a70 0x7f0240102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.489+0000 7f02475a7640 1 -- 172.21.15.29:0/2532989844 >> 172.21.15.29:0/2532989844 conn(0x7f0240079710 msgr2=0x7f0240079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:44.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.490+0000 7f02475a7640 1 -- 172.21.15.29:0/2532989844 shutdown_connections 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.490+0000 7f02475a7640 1 -- 172.21.15.29:0/2532989844 wait complete. 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.490+0000 7f02475a7640 1 Processor -- start 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.490+0000 7f02475a7640 1 -- start start 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f02475a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0240102a70 0x7f024019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f02475a7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02401083b0 0x7f024019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f02475a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0240108d00 0x7f024019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f02475a7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0240112a20 con 0x7f02401083b0 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f02475a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02401128a0 con 0x7f0240108d00 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f02475a7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0240112ba0 con 0x7f0240102a70 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02401083b0 0x7f024019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02401083b0 0x7f024019aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44208/0 (socket says 172.21.15.29:44208) 2024-09-21T07:08:44.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 -- 172.21.15.29:0/3513956984 learned_addr learned my addr 172.21.15.29:0/3513956984 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0245343640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0240102a70 0x7f024019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0245b44640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0240108d00 0x7f024019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 -- 172.21.15.29:0/3513956984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0240102a70 msgr2=0x7f024019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0240102a70 0x7f024019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 -- 172.21.15.29:0/3513956984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0240108d00 msgr2=0x7f024019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0240108d00 0x7f024019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 -- 172.21.15.29:0/3513956984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02401a03f0 con 0x7f02401083b0 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0245b44640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0240108d00 0x7f024019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.491+0000 7f0244b42640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02401083b0 0x7f024019aae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f023000c8c0 tx=0x7f023000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.492+0000 7f02367fc640 1 -- 172.21.15.29:0/3513956984 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230007bb0 con 0x7f02401083b0 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.492+0000 7f02367fc640 1 -- 172.21.15.29:0/3513956984 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0230007d50 con 0x7f02401083b0 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.492+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02401a06e0 con 0x7f02401083b0 2024-09-21T07:08:44.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.492+0000 7f02367fc640 1 -- 172.21.15.29:0/3513956984 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02300187c0 con 0x7f02401083b0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.492+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401a6f00 con 0x7f02401083b0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.493+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0240103cf0 con 0x7f02401083b0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.495+0000 7f02367fc640 1 -- 172.21.15.29:0/3513956984 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f023000fa20 con 0x7f02401083b0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.495+0000 7f02367fc640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f022c0b6650 0x7f022c0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.496+0000 7f0245343640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f022c0b6650 0x7f022c0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.496+0000 7f02367fc640 1 -- 172.21.15.29:0/3513956984 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f02300e7850 con 0x7f02401083b0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.496+0000 7f0245343640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f022c0b6650 0x7f022c0b8b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f023c00a810 tx=0x7f023c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.499+0000 7f02367fc640 1 -- 172.21.15.29:0/3513956984 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0230014030 con 0x7f02401083b0 2024-09-21T07:08:44.270 INFO:teuthology.orchestra.run.smithi029.stdout:34359738452 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.694+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f024019b670 con 0x7f02401083b0 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.694+0000 7f02367fc640 1 -- 172.21.15.29:0/3513956984 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f024019b670 con 0x7f02401083b0 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f022c0b6650 msgr2=0x7f022c0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f022c0b6650 0x7f022c0b8b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f023c00a810 tx=0x7f023c008040 comp rx=0 tx=0).stop 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02401083b0 msgr2=0x7f024019aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02401083b0 0x7f024019aae0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f023000c8c0 tx=0x7f023000cd80 comp rx=0 tx=0).stop 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 shutdown_connections 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f022c0b6650 0x7f022c0b8b60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0240108d00 0x7f024019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02401083b0 0x7f024019aae0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 --2- 172.21.15.29:0/3513956984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0240102a70 0x7f024019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 >> 172.21.15.29:0/3513956984 conn(0x7f0240079710 msgr2=0x7f0240101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 shutdown_connections 2024-09-21T07:08:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:43.697+0000 7f02475a7640 1 -- 172.21.15.29:0/3513956984 wait complete. 2024-09-21T07:08:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:44.272 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:44.482 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:44 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3333113749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:08:44.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:44 smithi029 ceph-mon[30983]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T07:08:44.992 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:45.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:44 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3333113749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:08:45.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:44 smithi066 ceph-mon[34793]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T07:08:45.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:44 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3333113749' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T07:08:45.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:44 smithi052 ceph-mon[34308]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-21T07:08:45.413 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738448 got 34359738452 for osd.0 2024-09-21T07:08:45.413 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.609+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/2448843863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc1083a0 msgr2=0x7f3fbc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.609+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/2448843863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc1083a0 0x7f3fbc1087b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009900 tx=0x7f3fac02a3f0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/2448843863 shutdown_connections 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/2448843863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fbc108cf0 0x7f3fbc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/2448843863 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc1083a0 0x7f3fbc1087b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/2448843863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fbc102a60 0x7f3fbc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/2448843863 >> 172.21.15.29:0/2448843863 conn(0x7f3fbc079730 msgr2=0x7f3fbc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/2448843863 shutdown_connections 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/2448843863 wait complete. 2024-09-21T07:08:45.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 Processor -- start 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.610+0000 7f3fc2d7c640 1 -- start start 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc2d7c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc102a60 0x7f3fbc19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc2d7c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fbc1083a0 0x7f3fbc19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc2d7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fbc108cf0 0x7f3fbc19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc2d7c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc112960 con 0x7f3fbc102a60 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc2d7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc1127e0 con 0x7f3fbc108cf0 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc2d7c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3fbc112ae0 con 0x7f3fbc1083a0 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc102a60 0x7f3fbc19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc102a60 0x7f3fbc19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44244/0 (socket says 172.21.15.29:44244) 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 -- 172.21.15.29:0/1660788646 learned_addr learned my addr 172.21.15.29:0/1660788646 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc1319640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fbc108cf0 0x7f3fbc19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fb3fff640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fbc1083a0 0x7f3fbc19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:45.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 -- 172.21.15.29:0/1660788646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fbc1083a0 msgr2=0x7f3fbc19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fbc1083a0 0x7f3fbc19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 -- 172.21.15.29:0/1660788646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fbc108cf0 msgr2=0x7f3fbc19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fbc108cf0 0x7f3fbc19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 -- 172.21.15.29:0/1660788646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fbc1a0350 con 0x7f3fbc102a60 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc1319640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fbc108cf0 0x7f3fbc19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc0b18640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc102a60 0x7f3fbc19a4a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800d950 tx=0x7f3fb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fb1ffb640 1 -- 172.21.15.29:0/1660788646 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8017070 con 0x7f3fbc102a60 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fbc1a0640 con 0x7f3fbc102a60 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fb1ffb640 1 -- 172.21.15.29:0/1660788646 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fb8009c30 con 0x7f3fbc102a60 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.611+0000 7f3fb1ffb640 1 -- 172.21.15.29:0/1660788646 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800f620 con 0x7f3fbc102a60 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.612+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fbc1a6e60 con 0x7f3fbc102a60 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.613+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fbc102e70 con 0x7f3fbc102a60 2024-09-21T07:08:45.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.614+0000 7f3fb1ffb640 1 -- 172.21.15.29:0/1660788646 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3fb8010460 con 0x7f3fbc102a60 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.615+0000 7f3fb1ffb640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3fa40b65d0 0x7f3fa40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.615+0000 7f3fb3fff640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3fa40b65d0 0x7f3fa40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.615+0000 7f3fb1ffb640 1 -- 172.21.15.29:0/1660788646 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3fb80e7180 con 0x7f3fbc102a60 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.616+0000 7f3fb3fff640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3fa40b65d0 0x7f3fa40b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:45.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.620+0000 7f3fb1ffb640 1 -- 172.21.15.29:0/1660788646 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fb80ad8c0 con 0x7f3fbc102a60 2024-09-21T07:08:45.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.818+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3fbc1a7090 con 0x7f3fbc102a60 2024-09-21T07:08:45.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.818+0000 7f3fb1ffb640 1 -- 172.21.15.29:0/1660788646 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3fb80b1ca0 con 0x7f3fbc102a60 2024-09-21T07:08:45.820 INFO:teuthology.orchestra.run.smithi029.stdout:103079215172 2024-09-21T07:08:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3fa40b65d0 msgr2=0x7f3fa40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3fa40b65d0 0x7f3fa40b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000c00 tx=0x7f3fac031400 comp rx=0 tx=0).stop 2024-09-21T07:08:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc102a60 msgr2=0x7f3fbc19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:45.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc102a60 0x7f3fbc19a4a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800d950 tx=0x7f3fb800de10 comp rx=0 tx=0).stop 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 shutdown_connections 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f3fa40b65d0 0x7f3fa40b8ae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fbc108cf0 0x7f3fbc19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fbc1083a0 0x7f3fbc19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 --2- 172.21.15.29:0/1660788646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fbc102a60 0x7f3fbc19a4a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.820+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 >> 172.21.15.29:0/1660788646 conn(0x7f3fbc079730 msgr2=0x7f3fbc107140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.821+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 shutdown_connections 2024-09-21T07:08:45.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:45.821+0000 7f3fc2d7c640 1 -- 172.21.15.29:0/1660788646 wait complete. 2024-09-21T07:08:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:45 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1660788646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:08:46.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:45 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1660788646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:08:46.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:45 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1660788646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T07:08:46.578 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215170 got 103079215172 for osd.3 2024-09-21T07:08:46.578 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:46 smithi029 ceph-mon[30983]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:08:47.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.146+0000 7fb699b6f640 1 -- 172.21.15.29:0/2980264653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694108d20 msgr2=0x7fb69410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.146+0000 7fb699b6f640 1 --2- 172.21.15.29:0/2980264653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694108d20 0x7fb69410f550 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009ca0 tx=0x7fb68c02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 -- 172.21.15.29:0/2980264653 shutdown_connections 2024-09-21T07:08:47.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 --2- 172.21.15.29:0/2980264653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694108d20 0x7fb69410f550 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 --2- 172.21.15.29:0/2980264653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6941083d0 0x7fb6941087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 --2- 172.21.15.29:0/2980264653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb694102ae0 0x7fb694102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 -- 172.21.15.29:0/2980264653 >> 172.21.15.29:0/2980264653 conn(0x7fb6940797b0 msgr2=0x7fb694079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 -- 172.21.15.29:0/2980264653 shutdown_connections 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 -- 172.21.15.29:0/2980264653 wait complete. 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 Processor -- start 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.147+0000 7fb699b6f640 1 -- start start 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb699b6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb694102ae0 0x7fb69419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb699b6f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6941083d0 0x7fb69419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb699b6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb694108d20 0x7fb69419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb699b6f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb6941129e0 con 0x7fb6941083d0 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb699b6f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb694112860 con 0x7fb694108d20 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb699b6f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb694112b60 con 0x7fb694102ae0 2024-09-21T07:08:47.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6941083d0 0x7fb69419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6941083d0 0x7fb69419b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44276/0 (socket says 172.21.15.29:44276) 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 -- 172.21.15.29:0/144518455 learned_addr learned my addr 172.21.15.29:0/144518455 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb6937fe640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb694102ae0 0x7fb69419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb693fff640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb694108d20 0x7fb69419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 -- 172.21.15.29:0/144518455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb694102ae0 msgr2=0x7fb69419b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb694102ae0 0x7fb69419b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 -- 172.21.15.29:0/144518455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb694108d20 msgr2=0x7fb69419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb694108d20 0x7fb69419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb68bfff640 1 -- 172.21.15.29:0/144518455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941a64e0 con 0x7fb6941083d0 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.148+0000 7fb693fff640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb694108d20 0x7fb69419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.149+0000 7fb68bfff640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6941083d0 0x7fb69419b790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00e9f0 tx=0x7fb67c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.149+0000 7fb6917fa640 1 -- 172.21.15.29:0/144518455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00ccc0 con 0x7fb6941083d0 2024-09-21T07:08:47.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.149+0000 7fb6917fa640 1 -- 172.21.15.29:0/144518455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb67c0108e0 con 0x7fb6941083d0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.149+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6941a67d0 con 0x7fb6941083d0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.149+0000 7fb6917fa640 1 -- 172.21.15.29:0/144518455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c018860 con 0x7fb6941083d0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.149+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6941a6d10 con 0x7fb6941083d0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.150+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb694102ef0 con 0x7fb6941083d0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.152+0000 7fb6917fa640 1 -- 172.21.15.29:0/144518455 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb67c010430 con 0x7fb6941083d0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.152+0000 7fb6917fa640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb6800b65d0 0x7fb6800b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.153+0000 7fb6937fe640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb6800b65d0 0x7fb6800b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.153+0000 7fb6917fa640 1 -- 172.21.15.29:0/144518455 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb67c0e7c80 con 0x7fb6941083d0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.153+0000 7fb6937fe640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb6800b65d0 0x7fb6800b8ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb69406c380 tx=0x7fb68400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:47.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.156+0000 7fb6917fa640 1 -- 172.21.15.29:0/144518455 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb67c0ae3c0 con 0x7fb6941083d0 2024-09-21T07:08:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:46 smithi052 ceph-mon[34308]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:08:47.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.060+0000 7f18ce049640 1 -- 172.21.15.29:0/2121479988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 msgr2=0x7f18c8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.060+0000 7f18ce049640 1 --2- 172.21.15.29:0/2121479988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8102ef0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009900 tx=0x7f18b802a410 comp rx=0 tx=0).stop 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.060+0000 7f18ce049640 1 -- 172.21.15.29:0/2121479988 shutdown_connections 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.060+0000 7f18ce049640 1 --2- 172.21.15.29:0/2121479988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c8108d20 0x7f18c810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.060+0000 7f18ce049640 1 --2- 172.21.15.29:0/2121479988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c81083d0 0x7f18c81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.060+0000 7f18ce049640 1 --2- 172.21.15.29:0/2121479988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8102ef0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.060+0000 7f18ce049640 1 -- 172.21.15.29:0/2121479988 >> 172.21.15.29:0/2121479988 conn(0x7f18c80797b0 msgr2=0x7f18c8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.061+0000 7f18ce049640 1 -- 172.21.15.29:0/2121479988 shutdown_connections 2024-09-21T07:08:47.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.061+0000 7f18ce049640 1 -- 172.21.15.29:0/2121479988 wait complete. 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.061+0000 7f18ce049640 1 Processor -- start 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.061+0000 7f18ce049640 1 -- start start 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18ce049640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18ce049640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c81083d0 0x7f18c8199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18ce049640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c8108d20 0x7f18c819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18ce049640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f18c81129e0 con 0x7f18c8102ae0 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18ce049640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8112860 con 0x7f18c8108d20 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18ce049640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8112b60 con 0x7f18c81083d0 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44264/0 (socket says 172.21.15.29:44264) 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 -- 172.21.15.29:0/3427897715 learned_addr learned my addr 172.21.15.29:0/3427897715 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:47.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c7fff640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c8108d20 0x7f18c819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c6ffd640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c81083d0 0x7f18c8199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 -- 172.21.15.29:0/3427897715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c81083d0 msgr2=0x7f18c8199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c81083d0 0x7f18c8199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 -- 172.21.15.29:0/3427897715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c8108d20 msgr2=0x7f18c819ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c8108d20 0x7f18c819ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.062+0000 7f18c77fe640 1 -- 172.21.15.29:0/3427897715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c819f400 con 0x7f18c8102ae0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.063+0000 7f18c77fe640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8199490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f18b8005940 tx=0x7f18b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.063+0000 7f18c4ff9640 1 -- 172.21.15.29:0/3427897715 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8035050 con 0x7f18c8102ae0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.063+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c819f690 con 0x7f18c8102ae0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.063+0000 7f18c4ff9640 1 -- 172.21.15.29:0/3427897715 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18b80394e0 con 0x7f18c8102ae0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.063+0000 7f18c4ff9640 1 -- 172.21.15.29:0/3427897715 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8005d50 con 0x7f18c8102ae0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.063+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c806b820 con 0x7f18c8102ae0 2024-09-21T07:08:47.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.064+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c8103d10 con 0x7f18c8102ae0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.066+0000 7f18c4ff9640 1 -- 172.21.15.29:0/3427897715 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f18b8039950 con 0x7f18c8102ae0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.066+0000 7f18c4ff9640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f18b00b65a0 0x7f18b00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.067+0000 7f18c6ffd640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f18b00b65a0 0x7f18b00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.067+0000 7f18c4ff9640 1 -- 172.21.15.29:0/3427897715 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f18b8109c00 con 0x7f18c8102ae0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.067+0000 7f18c6ffd640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f18b00b65a0 0x7f18b00b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18c8079cd0 tx=0x7f18bc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.070+0000 7f18c4ff9640 1 -- 172.21.15.29:0/3427897715 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18b80d0340 con 0x7f18c8102ae0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.278+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f18c806c240 con 0x7f18c8102ae0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.279+0000 7f18c4ff9640 1 -- 172.21.15.29:0/3427897715 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18b80d4720 con 0x7f18c8102ae0 2024-09-21T07:08:47.285 INFO:teuthology.orchestra.run.smithi029.stdout:55834574927 2024-09-21T07:08:47.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f18b00b65a0 msgr2=0x7f18b00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f18b00b65a0 0x7f18b00b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18c8079cd0 tx=0x7f18bc00b390 comp rx=0 tx=0).stop 2024-09-21T07:08:47.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 msgr2=0x7f18c8199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8199490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f18b8005940 tx=0x7f18b80042f0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 shutdown_connections 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f18b00b65a0 0x7f18b00b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18c8108d20 0x7f18c819ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18c81083d0 0x7f18c8199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 --2- 172.21.15.29:0/3427897715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18c8102ae0 0x7f18c8199490 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 >> 172.21.15.29:0/3427897715 conn(0x7f18c80797b0 msgr2=0x7f18c8106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.281+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 shutdown_connections 2024-09-21T07:08:47.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.282+0000 7f18ce049640 1 -- 172.21.15.29:0/3427897715 wait complete. 2024-09-21T07:08:47.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:46 smithi066 ceph-mon[34793]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:08:47.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.353+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb69402e640 con 0x7fb6941083d0 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.353+0000 7fb6917fa640 1 -- 172.21.15.29:0/144518455 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb67c0b27a0 con 0x7fb6941083d0 2024-09-21T07:08:47.355 INFO:teuthology.orchestra.run.smithi029.stdout:244813135909 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb6800b65d0 msgr2=0x7fb6800b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb6800b65d0 0x7fb6800b8ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb69406c380 tx=0x7fb68400b390 comp rx=0 tx=0).stop 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6941083d0 msgr2=0x7fb69419b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:47.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6941083d0 0x7fb69419b790 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00e9f0 tx=0x7fb67c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 shutdown_connections 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb6800b65d0 0x7fb6800b8ae0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb694108d20 0x7fb69419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6941083d0 0x7fb69419b790 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 --2- 172.21.15.29:0/144518455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb694102ae0 0x7fb69419b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 >> 172.21.15.29:0/144518455 conn(0x7fb6940797b0 msgr2=0x7fb6941043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 shutdown_connections 2024-09-21T07:08:47.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:47.355+0000 7fb699b6f640 1 -- 172.21.15.29:0/144518455 wait complete. 2024-09-21T07:08:48.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:47 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3427897715' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:08:48.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:47 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/144518455' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:08:48.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:47 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3427897715' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:08:48.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:47 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/144518455' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:08:48.250 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135906 got 244813135909 for osd.9 2024-09-21T07:08:48.250 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:48.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:47 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3427897715' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T07:08:48.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:47 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/144518455' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T07:08:48.914 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574927 for osd.1 2024-09-21T07:08:48.914 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:49.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:48 smithi052 ceph-mon[34308]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:08:49.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:48 smithi066 ceph-mon[34793]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:08:49.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:48 smithi029 ceph-mon[30983]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:08:49.436 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528364 got 193273528368 for osd.7 2024-09-21T07:08:49.436 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:49.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 -- 172.21.15.29:0/1916774692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 msgr2=0x7fb5b010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:49.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 --2- 172.21.15.29:0/1916774692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b010f520 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009ca0 tx=0x7fb5a802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:49.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 -- 172.21.15.29:0/1916774692 shutdown_connections 2024-09-21T07:08:49.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 --2- 172.21.15.29:0/1916774692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b010f520 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:49.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 --2- 172.21.15.29:0/1916774692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b01083a0 0x7fb5b01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:49.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 --2- 172.21.15.29:0/1916774692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5b0102a60 0x7fb5b0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:49.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 -- 172.21.15.29:0/1916774692 >> 172.21.15.29:0/1916774692 conn(0x7fb5b0079730 msgr2=0x7fb5b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:49.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 -- 172.21.15.29:0/1916774692 shutdown_connections 2024-09-21T07:08:49.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.866+0000 7fb5b5032640 1 -- 172.21.15.29:0/1916774692 wait complete. 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.867+0000 7fb5b5032640 1 Processor -- start 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.867+0000 7fb5b5032640 1 -- start start 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5b5032640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b0102a60 0x7fb5b01993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5b5032640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5b01083a0 0x7fb5b0199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5b5032640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5b5032640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01129c0 con 0x7fb5b0108cf0 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5b5032640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0112840 con 0x7fb5b0102a60 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5b5032640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0112b40 con 0x7fb5b01083a0 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b019ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48618/0 (socket says 172.21.15.29:48618) 2024-09-21T07:08:49.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 -- 172.21.15.29:0/610601947 learned_addr learned my addr 172.21.15.29:0/610601947 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5aed9d640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b0102a60 0x7fb5b01993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5ae59c640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5b01083a0 0x7fb5b0199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 -- 172.21.15.29:0/610601947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5b01083a0 msgr2=0x7fb5b0199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5b01083a0 0x7fb5b0199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 -- 172.21.15.29:0/610601947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b0102a60 msgr2=0x7fb5b01993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b0102a60 0x7fb5b01993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.868+0000 7fb5af59e640 1 -- 172.21.15.29:0/610601947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b019f280 con 0x7fb5b0108cf0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.869+0000 7fb5af59e640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b019ec10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8005cc0 tx=0x7fb5a802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.869+0000 7fb597fff640 1 -- 172.21.15.29:0/610601947 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8003cf0 con 0x7fb5b0108cf0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.869+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b019f510 con 0x7fb5b0108cf0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.869+0000 7fb597fff640 1 -- 172.21.15.29:0/610601947 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a80044f0 con 0x7fb5b0108cf0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.869+0000 7fb597fff640 1 -- 172.21.15.29:0/610601947 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a802fc30 con 0x7fb5b0108cf0 2024-09-21T07:08:49.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.869+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b019fa50 con 0x7fb5b0108cf0 2024-09-21T07:08:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.870+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b0102e70 con 0x7fb5b0108cf0 2024-09-21T07:08:49.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.871+0000 7fb597fff640 1 -- 172.21.15.29:0/610601947 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fb5a80046a0 con 0x7fb5b0108cf0 2024-09-21T07:08:49.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.873+0000 7fb597fff640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb5980b65d0 0x7fb5980b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:49.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.873+0000 7fb5aed9d640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb5980b65d0 0x7fb5980b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:49.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.873+0000 7fb597fff640 1 -- 172.21.15.29:0/610601947 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fb5a8108a30 con 0x7fb5b0108cf0 2024-09-21T07:08:49.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.873+0000 7fb5aed9d640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb5980b65d0 0x7fb5980b8ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000abe0 tx=0x7fb5a000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:49.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:49.876+0000 7fb597fff640 1 -- 172.21.15.29:0/610601947 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5a80cf170 con 0x7fb5b0108cf0 2024-09-21T07:08:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.081+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb5b010a5e0 con 0x7fb5b0108cf0 2024-09-21T07:08:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.081+0000 7fb597fff640 1 -- 172.21.15.29:0/610601947 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb5a80d3550 con 0x7fb5b0108cf0 2024-09-21T07:08:50.083 INFO:teuthology.orchestra.run.smithi029.stdout:128849018944 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb5980b65d0 msgr2=0x7fb5980b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb5980b65d0 0x7fb5980b8ae0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000abe0 tx=0x7fb5a000a2d0 comp rx=0 tx=0).stop 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 msgr2=0x7fb5b019ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b019ec10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8005cc0 tx=0x7fb5a802f470 comp rx=0 tx=0).stop 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 shutdown_connections 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fb5980b65d0 0x7fb5980b8ae0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5b0108cf0 0x7fb5b019ec10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5b01083a0 0x7fb5b0199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:50.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 --2- 172.21.15.29:0/610601947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5b0102a60 0x7fb5b01993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:50.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 >> 172.21.15.29:0/610601947 conn(0x7fb5b0079730 msgr2=0x7fb5b01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:50.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 shutdown_connections 2024-09-21T07:08:50.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:50.084+0000 7fb5b5032640 1 -- 172.21.15.29:0/610601947 wait complete. 2024-09-21T07:08:50.771 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018941 got 128849018944 for osd.4 2024-09-21T07:08:50.771 DEBUG:teuthology.parallel:result is None 2024-09-21T07:08:50.771 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T07:08:50.771 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:08:51.037 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:51.339 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:51 smithi029 ceph-mon[30983]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:08:51.339 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:51 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/610601947' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:08:51.339 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.340 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.340 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:51.340 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:51.340 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:51 smithi066 ceph-mon[34793]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:08:51.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:51 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/610601947' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:08:51.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:51.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:51.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:51 smithi052 ceph-mon[34308]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:08:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:51 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/610601947' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T07:08:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:08:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:08:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 -- 172.21.15.29:0/2994261463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 msgr2=0x7fd2a01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/2994261463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a01087b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd294009900 tx=0x7fd29402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 -- 172.21.15.29:0/2994261463 shutdown_connections 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/2994261463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2a0108cf0 0x7fd2a010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/2994261463 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a01087b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/2994261463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a0102a60 0x7fd2a0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 -- 172.21.15.29:0/2994261463 >> 172.21.15.29:0/2994261463 conn(0x7fd2a0079730 msgr2=0x7fd2a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 -- 172.21.15.29:0/2994261463 shutdown_connections 2024-09-21T07:08:51.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.556+0000 7fd2a63f9640 1 -- 172.21.15.29:0/2994261463 wait complete. 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 Processor -- start 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 -- start start 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a0102a60 0x7fd2a01993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a0199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2a0108cf0 0x7fd2a019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a0112960 con 0x7fd2a01083a0 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a01127e0 con 0x7fd2a0102a60 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a63f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a0112ae0 con 0x7fd2a0108cf0 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a0199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd29ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a0102a60 0x7fd2a01993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd29f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a0199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48648/0 (socket says 172.21.15.29:48648) 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd29f7fe640 1 -- 172.21.15.29:0/375010818 learned_addr learned my addr 172.21.15.29:0/375010818 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:51.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.557+0000 7fd2a4996640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2a0108cf0 0x7fd2a019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29f7fe640 1 -- 172.21.15.29:0/375010818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2a0108cf0 msgr2=0x7fd2a019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29f7fe640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2a0108cf0 0x7fd2a019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29f7fe640 1 -- 172.21.15.29:0/375010818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a0102a60 msgr2=0x7fd2a01993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29f7fe640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a0102a60 0x7fd2a01993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29f7fe640 1 -- 172.21.15.29:0/375010818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a019f340 con 0x7fd2a01083a0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29f7fe640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a0199970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd294006010 tx=0x7fd294004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29d7fa640 1 -- 172.21.15.29:0/375010818 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29403f030 con 0x7fd2a01083a0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a019f5d0 con 0x7fd2a01083a0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29d7fa640 1 -- 172.21.15.29:0/375010818 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd294003aa0 con 0x7fd2a01083a0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd29d7fa640 1 -- 172.21.15.29:0/375010818 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294035070 con 0x7fd2a01083a0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.558+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a01a5d90 con 0x7fd2a01083a0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.559+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a0102e70 con 0x7fd2a01083a0 2024-09-21T07:08:51.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.561+0000 7fd29d7fa640 1 -- 172.21.15.29:0/375010818 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd294042030 con 0x7fd2a01083a0 2024-09-21T07:08:51.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.562+0000 7fd29d7fa640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd2880b65a0 0x7fd2880b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:51.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.562+0000 7fd29ffff640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd2880b65a0 0x7fd2880b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:51.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.562+0000 7fd29d7fa640 1 -- 172.21.15.29:0/375010818 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd294107cd0 con 0x7fd2a01083a0 2024-09-21T07:08:51.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.562+0000 7fd29ffff640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd2880b65a0 0x7fd2880b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd29000bbe0 tx=0x7fd29000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:51.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.565+0000 7fd29d7fa640 1 -- 172.21.15.29:0/375010818 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2940d2790 con 0x7fd2a01083a0 2024-09-21T07:08:51.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.771+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2a0063800 con 0x7fd2880b65a0 2024-09-21T07:08:51.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.775+0000 7fd29d7fa640 1 -- 172.21.15.29:0/375010818 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258749 (secure 0 0 0) 0x7fd2a0063800 con 0x7fd2880b65a0 2024-09-21T07:08:51.779 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:51.780 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T07:08:51.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd2880b65a0 msgr2=0x7fd2880b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:51.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd2880b65a0 0x7fd2880b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd29000bbe0 tx=0x7fd29000b390 comp rx=0 tx=0).stop 2024-09-21T07:08:51.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 msgr2=0x7fd2a0199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a0199970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd294006010 tx=0x7fd294004060 comp rx=0 tx=0).stop 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 shutdown_connections 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd2880b65a0 0x7fd2880b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2a0108cf0 0x7fd2a019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2a01083a0 0x7fd2a0199970 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 --2- 172.21.15.29:0/375010818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a0102a60 0x7fd2a01993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.778+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 >> 172.21.15.29:0/375010818 conn(0x7fd2a0079730 msgr2=0x7fd2a01044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.779+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 shutdown_connections 2024-09-21T07:08:51.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:51.779+0000 7fd2a63f9640 1 -- 172.21.15.29:0/375010818 wait complete. 2024-09-21T07:08:52.560 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-21T07:08:50.026661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662954,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":751,"num_read_kb":482,"num_write":371,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386052,"kb_used_data":11784,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555772,"statfs":{"total":1151940427776,"available":1151545110528,"internally_reserved":0,"allocated":12066816,"data_stored":6714234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003172"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665830+0000","last_change":"2024-09-21T07:07:32.566786+0000","last_active":"2024-09-21T07:07:57.665830+0000","last_peered":"2024-09-21T07:07:57.665830+0000","last_clean":"2024-09-21T07:07:57.665830+0000","last_became_active":"2024-09-21T07:07:32.565722+0000","last_became_peered":"2024-09-21T07:07:32.565722+0000","last_unstale":"2024-09-21T07:07:57.665830+0000","last_undegraded":"2024-09-21T07:07:57.665830+0000","last_fullsized":"2024-09-21T07:07:57.665830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:22.389773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700880+0000","last_change":"2024-09-21T07:07:32.556460+0000","last_active":"2024-09-21T07:07:57.700880+0000","last_peered":"2024-09-21T07:07:57.700880+0000","last_clean":"2024-09-21T07:07:57.700880+0000","last_became_active":"2024-09-21T07:07:32.555738+0000","last_became_peered":"2024-09-21T07:07:32.555738+0000","last_unstale":"2024-09-21T07:07:57.700880+0000","last_undegraded":"2024-09-21T07:07:57.700880+0000","last_fullsized":"2024-09-21T07:07:57.700880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.921413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700779+0000","last_change":"2024-09-21T07:07:32.565814+0000","last_active":"2024-09-21T07:07:57.700779+0000","last_peered":"2024-09-21T07:07:57.700779+0000","last_clean":"2024-09-21T07:07:57.700779+0000","last_became_active":"2024-09-21T07:07:32.565401+0000","last_became_peered":"2024-09-21T07:07:32.565401+0000","last_unstale":"2024-09-21T07:07:57.700779+0000","last_undegraded":"2024-09-21T07:07:57.700779+0000","last_fullsized":"2024-09-21T07:07:57.700779+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:56.705903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668559+0000","last_change":"2024-09-21T07:07:32.554713+0000","last_active":"2024-09-21T07:07:57.668559+0000","last_peered":"2024-09-21T07:07:57.668559+0000","last_clean":"2024-09-21T07:07:57.668559+0000","last_became_active":"2024-09-21T07:07:32.554203+0000","last_became_peered":"2024-09-21T07:07:32.554203+0000","last_unstale":"2024-09-21T07:07:57.668559+0000","last_undegraded":"2024-09-21T07:07:57.668559+0000","last_fullsized":"2024-09-21T07:07:57.668559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:29.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665134+0000","last_change":"2024-09-21T07:07:32.566048+0000","last_active":"2024-09-21T07:07:57.665134+0000","last_peered":"2024-09-21T07:07:57.665134+0000","last_clean":"2024-09-21T07:07:57.665134+0000","last_became_active":"2024-09-21T07:07:32.565659+0000","last_became_peered":"2024-09-21T07:07:32.565659+0000","last_unstale":"2024-09-21T07:07:57.665134+0000","last_undegraded":"2024-09-21T07:07:57.665134+0000","last_fullsized":"2024-09-21T07:07:57.665134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:56.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662196+0000","last_change":"2024-09-21T07:07:32.550492+0000","last_active":"2024-09-21T07:07:57.662196+0000","last_peered":"2024-09-21T07:07:57.662196+0000","last_clean":"2024-09-21T07:07:57.662196+0000","last_became_active":"2024-09-21T07:07:32.549691+0000","last_became_peered":"2024-09-21T07:07:32.549691+0000","last_unstale":"2024-09-21T07:07:57.662196+0000","last_undegraded":"2024-09-21T07:07:57.662196+0000","last_fullsized":"2024-09-21T07:07:57.662196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.890164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665985+0000","last_change":"2024-09-21T07:07:32.560258+0000","last_active":"2024-09-21T07:07:57.665985+0000","last_peered":"2024-09-21T07:07:57.665985+0000","last_clean":"2024-09-21T07:07:57.665985+0000","last_became_active":"2024-09-21T07:07:32.559890+0000","last_became_peered":"2024-09-21T07:07:32.559890+0000","last_unstale":"2024-09-21T07:07:57.665985+0000","last_undegraded":"2024-09-21T07:07:57.665985+0000","last_fullsized":"2024-09-21T07:07:57.665985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.794736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667805+0000","last_change":"2024-09-21T07:07:32.560923+0000","last_active":"2024-09-21T07:07:57.667805+0000","last_peered":"2024-09-21T07:07:57.667805+0000","last_clean":"2024-09-21T07:07:57.667805+0000","last_became_active":"2024-09-21T07:07:32.560509+0000","last_became_peered":"2024-09-21T07:07:32.560509+0000","last_unstale":"2024-09-21T07:07:57.667805+0000","last_undegraded":"2024-09-21T07:07:57.667805+0000","last_fullsized":"2024-09-21T07:07:57.667805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:59.576434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670812+0000","last_change":"2024-09-21T07:07:32.564475+0000","last_active":"2024-09-21T07:07:57.670812+0000","last_peered":"2024-09-21T07:07:57.670812+0000","last_clean":"2024-09-21T07:07:57.670812+0000","last_became_active":"2024-09-21T07:07:32.564115+0000","last_became_peered":"2024-09-21T07:07:32.564115+0000","last_unstale":"2024-09-21T07:07:57.670812+0000","last_undegraded":"2024-09-21T07:07:57.670812+0000","last_fullsized":"2024-09-21T07:07:57.670812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:03.989109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662889+0000","last_change":"2024-09-21T07:07:32.557377+0000","last_active":"2024-09-21T07:07:57.662889+0000","last_peered":"2024-09-21T07:07:57.662889+0000","last_clean":"2024-09-21T07:07:57.662889+0000","last_became_active":"2024-09-21T07:07:32.556732+0000","last_became_peered":"2024-09-21T07:07:32.556732+0000","last_unstale":"2024-09-21T07:07:57.662889+0000","last_undegraded":"2024-09-21T07:07:57.662889+0000","last_fullsized":"2024-09-21T07:07:57.662889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:32.474690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666465+0000","last_change":"2024-09-21T07:07:32.558691+0000","last_active":"2024-09-21T07:07:57.666465+0000","last_peered":"2024-09-21T07:07:57.666465+0000","last_clean":"2024-09-21T07:07:57.666465+0000","last_became_active":"2024-09-21T07:07:32.558029+0000","last_became_peered":"2024-09-21T07:07:32.558029+0000","last_unstale":"2024-09-21T07:07:57.666465+0000","last_undegraded":"2024-09-21T07:07:57.666465+0000","last_fullsized":"2024-09-21T07:07:57.666465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.378786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668606+0000","last_change":"2024-09-21T07:07:32.556500+0000","last_active":"2024-09-21T07:07:57.668606+0000","last_peered":"2024-09-21T07:07:57.668606+0000","last_clean":"2024-09-21T07:07:57.668606+0000","last_became_active":"2024-09-21T07:07:32.555529+0000","last_became_peered":"2024-09-21T07:07:32.555529+0000","last_unstale":"2024-09-21T07:07:57.668606+0000","last_undegraded":"2024-09-21T07:07:57.668606+0000","last_fullsized":"2024-09-21T07:07:57.668606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.494498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664151+0000","last_change":"2024-09-21T07:07:32.560235+0000","last_active":"2024-09-21T07:07:57.664151+0000","last_peered":"2024-09-21T07:07:57.664151+0000","last_clean":"2024-09-21T07:07:57.664151+0000","last_became_active":"2024-09-21T07:07:32.559834+0000","last_became_peered":"2024-09-21T07:07:32.559834+0000","last_unstale":"2024-09-21T07:07:57.664151+0000","last_undegraded":"2024-09-21T07:07:57.664151+0000","last_fullsized":"2024-09-21T07:07:57.664151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:30.090878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700558+0000","last_change":"2024-09-21T07:07:32.554158+0000","last_active":"2024-09-21T07:07:57.700558+0000","last_peered":"2024-09-21T07:07:57.700558+0000","last_clean":"2024-09-21T07:07:57.700558+0000","last_became_active":"2024-09-21T07:07:32.553837+0000","last_became_peered":"2024-09-21T07:07:32.553837+0000","last_unstale":"2024-09-21T07:07:57.700558+0000","last_undegraded":"2024-09-21T07:07:57.700558+0000","last_fullsized":"2024-09-21T07:07:57.700558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:23.845629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700519+0000","last_change":"2024-09-21T07:07:32.556921+0000","last_active":"2024-09-21T07:07:57.700519+0000","last_peered":"2024-09-21T07:07:57.700519+0000","last_clean":"2024-09-21T07:07:57.700519+0000","last_became_active":"2024-09-21T07:07:32.556529+0000","last_became_peered":"2024-09-21T07:07:32.556529+0000","last_unstale":"2024-09-21T07:07:57.700519+0000","last_undegraded":"2024-09-21T07:07:57.700519+0000","last_fullsized":"2024-09-21T07:07:57.700519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.447617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669857+0000","last_change":"2024-09-21T07:07:32.567572+0000","last_active":"2024-09-21T07:07:57.669857+0000","last_peered":"2024-09-21T07:07:57.669857+0000","last_clean":"2024-09-21T07:07:57.669857+0000","last_became_active":"2024-09-21T07:07:32.567159+0000","last_became_peered":"2024-09-21T07:07:32.567159+0000","last_unstale":"2024-09-21T07:07:57.669857+0000","last_undegraded":"2024-09-21T07:07:57.669857+0000","last_fullsized":"2024-09-21T07:07:57.669857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.316539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665990+0000","last_change":"2024-09-21T07:07:32.567213+0000","last_active":"2024-09-21T07:07:57.665990+0000","last_peered":"2024-09-21T07:07:57.665990+0000","last_clean":"2024-09-21T07:07:57.665990+0000","last_became_active":"2024-09-21T07:07:32.566284+0000","last_became_peered":"2024-09-21T07:07:32.566284+0000","last_unstale":"2024-09-21T07:07:57.665990+0000","last_undegraded":"2024-09-21T07:07:57.665990+0000","last_fullsized":"2024-09-21T07:07:57.665990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661267+0000","last_change":"2024-09-21T07:07:32.551695+0000","last_active":"2024-09-21T07:07:57.661267+0000","last_peered":"2024-09-21T07:07:57.661267+0000","last_clean":"2024-09-21T07:07:57.661267+0000","last_became_active":"2024-09-21T07:07:32.551282+0000","last_became_peered":"2024-09-21T07:07:32.551282+0000","last_unstale":"2024-09-21T07:07:57.661267+0000","last_undegraded":"2024-09-21T07:07:57.661267+0000","last_fullsized":"2024-09-21T07:07:57.661267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:33.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669799+0000","last_change":"2024-09-21T07:07:32.551000+0000","last_active":"2024-09-21T07:07:57.669799+0000","last_peered":"2024-09-21T07:07:57.669799+0000","last_clean":"2024-09-21T07:07:57.669799+0000","last_became_active":"2024-09-21T07:07:32.550590+0000","last_became_peered":"2024-09-21T07:07:32.550590+0000","last_unstale":"2024-09-21T07:07:57.669799+0000","last_undegraded":"2024-09-21T07:07:57.669799+0000","last_fullsized":"2024-09-21T07:07:57.669799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:30.213470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668399+0000","last_change":"2024-09-21T07:07:57.668284+0000","last_active":"2024-09-21T07:07:57.668399+0000","last_peered":"2024-09-21T07:07:57.668399+0000","last_clean":"2024-09-21T07:07:57.668399+0000","last_became_active":"2024-09-21T07:07:57.667145+0000","last_became_peered":"2024-09-21T07:07:57.667145+0000","last_unstale":"2024-09-21T07:07:57.668399+0000","last_undegraded":"2024-09-21T07:07:57.668399+0000","last_fullsized":"2024-09-21T07:07:57.668399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:11.662321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664164+0000","last_change":"2024-09-21T07:07:32.555752+0000","last_active":"2024-09-21T07:07:57.664164+0000","last_peered":"2024-09-21T07:07:57.664164+0000","last_clean":"2024-09-21T07:07:57.664164+0000","last_became_active":"2024-09-21T07:07:32.555057+0000","last_became_peered":"2024-09-21T07:07:32.555057+0000","last_unstale":"2024-09-21T07:07:57.664164+0000","last_undegraded":"2024-09-21T07:07:57.664164+0000","last_fullsized":"2024-09-21T07:07:57.664164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:03.161990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670600+0000","last_change":"2024-09-21T07:07:32.555589+0000","last_active":"2024-09-21T07:07:57.670600+0000","last_peered":"2024-09-21T07:07:57.670600+0000","last_clean":"2024-09-21T07:07:57.670600+0000","last_became_active":"2024-09-21T07:07:32.555037+0000","last_became_peered":"2024-09-21T07:07:32.555037+0000","last_unstale":"2024-09-21T07:07:57.670600+0000","last_undegraded":"2024-09-21T07:07:57.670600+0000","last_fullsized":"2024-09-21T07:07:57.670600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:25.346546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667780+0000","last_change":"2024-09-21T07:07:32.559407+0000","last_active":"2024-09-21T07:07:57.667780+0000","last_peered":"2024-09-21T07:07:57.667780+0000","last_clean":"2024-09-21T07:07:57.667780+0000","last_became_active":"2024-09-21T07:07:32.559112+0000","last_became_peered":"2024-09-21T07:07:32.559112+0000","last_unstale":"2024-09-21T07:07:57.667780+0000","last_undegraded":"2024-09-21T07:07:57.667780+0000","last_fullsized":"2024-09-21T07:07:57.667780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:13.970511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669197+0000","last_change":"2024-09-21T07:07:32.564798+0000","last_active":"2024-09-21T07:07:57.669197+0000","last_peered":"2024-09-21T07:07:57.669197+0000","last_clean":"2024-09-21T07:07:57.669197+0000","last_became_active":"2024-09-21T07:07:32.564381+0000","last_became_peered":"2024-09-21T07:07:32.564381+0000","last_unstale":"2024-09-21T07:07:57.669197+0000","last_undegraded":"2024-09-21T07:07:57.669197+0000","last_fullsized":"2024-09-21T07:07:57.669197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:19.667252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668233+0000","last_change":"2024-09-21T07:07:32.555274+0000","last_active":"2024-09-21T07:07:57.668233+0000","last_peered":"2024-09-21T07:07:57.668233+0000","last_clean":"2024-09-21T07:07:57.668233+0000","last_became_active":"2024-09-21T07:07:32.554816+0000","last_became_peered":"2024-09-21T07:07:32.554816+0000","last_unstale":"2024-09-21T07:07:57.668233+0000","last_undegraded":"2024-09-21T07:07:57.668233+0000","last_fullsized":"2024-09-21T07:07:57.668233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.018974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.671064+0000","last_change":"2024-09-21T07:07:32.555655+0000","last_active":"2024-09-21T07:07:57.671064+0000","last_peered":"2024-09-21T07:07:57.671064+0000","last_clean":"2024-09-21T07:07:57.671064+0000","last_became_active":"2024-09-21T07:07:32.555240+0000","last_became_peered":"2024-09-21T07:07:32.555240+0000","last_unstale":"2024-09-21T07:07:57.671064+0000","last_undegraded":"2024-09-21T07:07:57.671064+0000","last_fullsized":"2024-09-21T07:07:57.671064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:51.550091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664496+0000","last_change":"2024-09-21T07:07:32.570761+0000","last_active":"2024-09-21T07:07:57.664496+0000","last_peered":"2024-09-21T07:07:57.664496+0000","last_clean":"2024-09-21T07:07:57.664496+0000","last_became_active":"2024-09-21T07:07:32.569555+0000","last_became_peered":"2024-09-21T07:07:32.569555+0000","last_unstale":"2024-09-21T07:07:57.664496+0000","last_undegraded":"2024-09-21T07:07:57.664496+0000","last_fullsized":"2024-09-21T07:07:57.664496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:23.414096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.702052+0000","last_change":"2024-09-21T07:07:57.701944+0000","last_active":"2024-09-21T07:07:57.702052+0000","last_peered":"2024-09-21T07:07:57.702052+0000","last_clean":"2024-09-21T07:07:57.702052+0000","last_became_active":"2024-09-21T07:07:57.701461+0000","last_became_peered":"2024-09-21T07:07:57.701461+0000","last_unstale":"2024-09-21T07:07:57.702052+0000","last_undegraded":"2024-09-21T07:07:57.702052+0000","last_fullsized":"2024-09-21T07:07:57.702052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:36.219766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700760+0000","last_change":"2024-09-21T07:07:32.550889+0000","last_active":"2024-09-21T07:07:57.700760+0000","last_peered":"2024-09-21T07:07:57.700760+0000","last_clean":"2024-09-21T07:07:57.700760+0000","last_became_active":"2024-09-21T07:07:32.550559+0000","last_became_peered":"2024-09-21T07:07:32.550559+0000","last_unstale":"2024-09-21T07:07:57.700760+0000","last_undegraded":"2024-09-21T07:07:57.700760+0000","last_fullsized":"2024-09-21T07:07:57.700760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:35.575626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669528+0000","last_change":"2024-09-21T07:07:32.552019+0000","last_active":"2024-09-21T07:07:57.669528+0000","last_peered":"2024-09-21T07:07:57.669528+0000","last_clean":"2024-09-21T07:07:57.669528+0000","last_became_active":"2024-09-21T07:07:32.551562+0000","last_became_peered":"2024-09-21T07:07:32.551562+0000","last_unstale":"2024-09-21T07:07:57.669528+0000","last_undegraded":"2024-09-21T07:07:57.669528+0000","last_fullsized":"2024-09-21T07:07:57.669528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:25.932560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669832+0000","last_change":"2024-09-21T07:07:32.556938+0000","last_active":"2024-09-21T07:07:57.669832+0000","last_peered":"2024-09-21T07:07:57.669832+0000","last_clean":"2024-09-21T07:07:57.669832+0000","last_became_active":"2024-09-21T07:07:32.556331+0000","last_became_peered":"2024-09-21T07:07:32.556331+0000","last_unstale":"2024-09-21T07:07:57.669832+0000","last_undegraded":"2024-09-21T07:07:57.669832+0000","last_fullsized":"2024-09-21T07:07:57.669832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.358076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664137+0000","last_change":"2024-09-21T07:07:32.561984+0000","last_active":"2024-09-21T07:07:57.664137+0000","last_peered":"2024-09-21T07:07:57.664137+0000","last_clean":"2024-09-21T07:07:57.664137+0000","last_became_active":"2024-09-21T07:07:32.561227+0000","last_became_peered":"2024-09-21T07:07:32.561227+0000","last_unstale":"2024-09-21T07:07:57.664137+0000","last_undegraded":"2024-09-21T07:07:57.664137+0000","last_fullsized":"2024-09-21T07:07:57.664137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:35.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666875+0000","last_change":"2024-09-21T07:07:32.567454+0000","last_active":"2024-09-21T07:07:57.666875+0000","last_peered":"2024-09-21T07:07:57.666875+0000","last_clean":"2024-09-21T07:07:57.666875+0000","last_became_active":"2024-09-21T07:07:32.567063+0000","last_became_peered":"2024-09-21T07:07:32.567063+0000","last_unstale":"2024-09-21T07:07:57.666875+0000","last_undegraded":"2024-09-21T07:07:57.666875+0000","last_fullsized":"2024-09-21T07:07:57.666875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.466771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:44.726399+0000","last_change":"2024-09-21T07:07:30.548785+0000","last_active":"2024-09-21T07:08:44.726399+0000","last_peered":"2024-09-21T07:08:44.726399+0000","last_clean":"2024-09-21T07:08:44.726399+0000","last_became_active":"2024-09-21T07:07:30.547764+0000","last_became_peered":"2024-09-21T07:07:30.547764+0000","last_unstale":"2024-09-21T07:08:44.726399+0000","last_undegraded":"2024-09-21T07:08:44.726399+0000","last_fullsized":"2024-09-21T07:08:44.726399+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:18.115002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669774+0000","last_change":"2024-09-21T07:07:57.669607+0000","last_active":"2024-09-21T07:07:57.669774+0000","last_peered":"2024-09-21T07:07:57.669774+0000","last_clean":"2024-09-21T07:07:57.669774+0000","last_became_active":"2024-09-21T07:07:57.669149+0000","last_became_peered":"2024-09-21T07:07:57.669149+0000","last_unstale":"2024-09-21T07:07:57.669774+0000","last_undegraded":"2024-09-21T07:07:57.669774+0000","last_fullsized":"2024-09-21T07:07:57.669774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:20.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.686559+0000","last_change":"2024-09-21T07:07:57.686466+0000","last_active":"2024-09-21T07:07:57.686559+0000","last_peered":"2024-09-21T07:07:57.686559+0000","last_clean":"2024-09-21T07:07:57.686559+0000","last_became_active":"2024-09-21T07:07:57.671977+0000","last_became_peered":"2024-09-21T07:07:57.671977+0000","last_unstale":"2024-09-21T07:07:57.686559+0000","last_undegraded":"2024-09-21T07:07:57.686559+0000","last_fullsized":"2024-09-21T07:07:57.686559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:26.134854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663868+0000","last_change":"2024-09-21T07:07:30.539941+0000","last_active":"2024-09-21T07:07:57.663868+0000","last_peered":"2024-09-21T07:07:57.663868+0000","last_clean":"2024-09-21T07:07:57.663868+0000","last_became_active":"2024-09-21T07:07:30.539401+0000","last_became_peered":"2024-09-21T07:07:30.539401+0000","last_unstale":"2024-09-21T07:07:57.663868+0000","last_undegraded":"2024-09-21T07:07:57.663868+0000","last_fullsized":"2024-09-21T07:07:57.663868+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:15.184453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667870+0000","last_change":"2024-09-21T07:07:32.556958+0000","last_active":"2024-09-21T07:07:57.667870+0000","last_peered":"2024-09-21T07:07:57.667870+0000","last_clean":"2024-09-21T07:07:57.667870+0000","last_became_active":"2024-09-21T07:07:32.556581+0000","last_became_peered":"2024-09-21T07:07:32.556581+0000","last_unstale":"2024-09-21T07:07:57.667870+0000","last_undegraded":"2024-09-21T07:07:57.667870+0000","last_fullsized":"2024-09-21T07:07:57.667870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:57.618263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668760+0000","last_change":"2024-09-21T07:07:30.547760+0000","last_active":"2024-09-21T07:07:57.668760+0000","last_peered":"2024-09-21T07:07:57.668760+0000","last_clean":"2024-09-21T07:07:57.668760+0000","last_became_active":"2024-09-21T07:07:30.547327+0000","last_became_peered":"2024-09-21T07:07:30.547327+0000","last_unstale":"2024-09-21T07:07:57.668760+0000","last_undegraded":"2024-09-21T07:07:57.668760+0000","last_fullsized":"2024-09-21T07:07:57.668760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:01.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.660833+0000","last_change":"2024-09-21T07:07:32.552691+0000","last_active":"2024-09-21T07:07:57.660833+0000","last_peered":"2024-09-21T07:07:57.660833+0000","last_clean":"2024-09-21T07:07:57.660833+0000","last_became_active":"2024-09-21T07:07:32.552321+0000","last_became_peered":"2024-09-21T07:07:32.552321+0000","last_unstale":"2024-09-21T07:07:57.660833+0000","last_undegraded":"2024-09-21T07:07:57.660833+0000","last_fullsized":"2024-09-21T07:07:57.660833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:56.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":157,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:48.731772+0000","last_change":"2024-09-21T07:07:30.545281+0000","last_active":"2024-09-21T07:08:48.731772+0000","last_peered":"2024-09-21T07:08:48.731772+0000","last_clean":"2024-09-21T07:08:48.731772+0000","last_became_active":"2024-09-21T07:07:30.544823+0000","last_became_peered":"2024-09-21T07:07:30.544823+0000","last_unstale":"2024-09-21T07:08:48.731772+0000","last_undegraded":"2024-09-21T07:08:48.731772+0000","last_fullsized":"2024-09-21T07:08:48.731772+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.659421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670838+0000","last_change":"2024-09-21T07:07:32.567833+0000","last_active":"2024-09-21T07:07:57.670838+0000","last_peered":"2024-09-21T07:07:57.670838+0000","last_clean":"2024-09-21T07:07:57.670838+0000","last_became_active":"2024-09-21T07:07:32.566902+0000","last_became_peered":"2024-09-21T07:07:32.566902+0000","last_unstale":"2024-09-21T07:07:57.670838+0000","last_undegraded":"2024-09-21T07:07:57.670838+0000","last_fullsized":"2024-09-21T07:07:57.670838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.871038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.681468+0000","last_change":"2024-09-21T07:07:57.681319+0000","last_active":"2024-09-21T07:07:57.681468+0000","last_peered":"2024-09-21T07:07:57.681468+0000","last_clean":"2024-09-21T07:07:57.681468+0000","last_became_active":"2024-09-21T07:07:57.671744+0000","last_became_peered":"2024-09-21T07:07:57.671744+0000","last_unstale":"2024-09-21T07:07:57.681468+0000","last_undegraded":"2024-09-21T07:07:57.681468+0000","last_fullsized":"2024-09-21T07:07:57.681468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:51.145118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701091+0000","last_change":"2024-09-21T07:07:32.561445+0000","last_active":"2024-09-21T07:07:57.701091+0000","last_peered":"2024-09-21T07:07:57.701091+0000","last_clean":"2024-09-21T07:07:57.701091+0000","last_became_active":"2024-09-21T07:07:32.561033+0000","last_became_peered":"2024-09-21T07:07:32.561033+0000","last_unstale":"2024-09-21T07:07:57.701091+0000","last_undegraded":"2024-09-21T07:07:57.701091+0000","last_fullsized":"2024-09-21T07:07:57.701091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:30.261234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668524+0000","last_change":"2024-09-21T07:07:30.755110+0000","last_active":"2024-09-21T07:07:57.668524+0000","last_peered":"2024-09-21T07:07:57.668524+0000","last_clean":"2024-09-21T07:07:57.668524+0000","last_became_active":"2024-09-21T07:07:30.754680+0000","last_became_peered":"2024-09-21T07:07:30.754680+0000","last_unstale":"2024-09-21T07:07:57.668524+0000","last_undegraded":"2024-09-21T07:07:57.668524+0000","last_fullsized":"2024-09-21T07:07:57.668524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.202010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670386+0000","last_change":"2024-09-21T07:07:32.557349+0000","last_active":"2024-09-21T07:07:57.670386+0000","last_peered":"2024-09-21T07:07:57.670386+0000","last_clean":"2024-09-21T07:07:57.670386+0000","last_became_active":"2024-09-21T07:07:32.554342+0000","last_became_peered":"2024-09-21T07:07:32.554342+0000","last_unstale":"2024-09-21T07:07:57.670386+0000","last_undegraded":"2024-09-21T07:07:57.670386+0000","last_fullsized":"2024-09-21T07:07:57.670386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:21.356410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":192,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:48.731757+0000","last_change":"2024-09-21T07:07:30.547691+0000","last_active":"2024-09-21T07:08:48.731757+0000","last_peered":"2024-09-21T07:08:48.731757+0000","last_clean":"2024-09-21T07:08:48.731757+0000","last_became_active":"2024-09-21T07:07:30.547280+0000","last_became_peered":"2024-09-21T07:07:30.547280+0000","last_unstale":"2024-09-21T07:08:48.731757+0000","last_undegraded":"2024-09-21T07:08:48.731757+0000","last_fullsized":"2024-09-21T07:08:48.731757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:24.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64757,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":32,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665578+0000","last_change":"2024-09-21T07:07:32.569291+0000","last_active":"2024-09-21T07:07:57.665578+0000","last_peered":"2024-09-21T07:07:57.665578+0000","last_clean":"2024-09-21T07:07:57.665578+0000","last_became_active":"2024-09-21T07:07:32.568503+0000","last_became_peered":"2024-09-21T07:07:32.568503+0000","last_unstale":"2024-09-21T07:07:57.665578+0000","last_undegraded":"2024-09-21T07:07:57.665578+0000","last_fullsized":"2024-09-21T07:07:57.665578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:56.184795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669620+0000","last_change":"2024-09-21T07:07:30.546624+0000","last_active":"2024-09-21T07:07:57.669620+0000","last_peered":"2024-09-21T07:07:57.669620+0000","last_clean":"2024-09-21T07:07:57.669620+0000","last_became_active":"2024-09-21T07:07:30.545497+0000","last_became_peered":"2024-09-21T07:07:30.545497+0000","last_unstale":"2024-09-21T07:07:57.669620+0000","last_undegraded":"2024-09-21T07:07:57.669620+0000","last_fullsized":"2024-09-21T07:07:57.669620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.963089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663965+0000","last_change":"2024-09-21T07:07:32.551123+0000","last_active":"2024-09-21T07:07:57.663965+0000","last_peered":"2024-09-21T07:07:57.663965+0000","last_clean":"2024-09-21T07:07:57.663965+0000","last_became_active":"2024-09-21T07:07:32.550423+0000","last_became_peered":"2024-09-21T07:07:32.550423+0000","last_unstale":"2024-09-21T07:07:57.663965+0000","last_undegraded":"2024-09-21T07:07:57.663965+0000","last_fullsized":"2024-09-21T07:07:57.663965+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:00.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668428+0000","last_change":"2024-09-21T07:07:30.550102+0000","last_active":"2024-09-21T07:07:57.668428+0000","last_peered":"2024-09-21T07:07:57.668428+0000","last_clean":"2024-09-21T07:07:57.668428+0000","last_became_active":"2024-09-21T07:07:30.549609+0000","last_became_peered":"2024-09-21T07:07:30.549609+0000","last_unstale":"2024-09-21T07:07:57.668428+0000","last_undegraded":"2024-09-21T07:07:57.668428+0000","last_fullsized":"2024-09-21T07:07:57.668428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:58.587612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666452+0000","last_change":"2024-09-21T07:07:32.556167+0000","last_active":"2024-09-21T07:07:57.666452+0000","last_peered":"2024-09-21T07:07:57.666452+0000","last_clean":"2024-09-21T07:07:57.666452+0000","last_became_active":"2024-09-21T07:07:32.555372+0000","last_became_peered":"2024-09-21T07:07:32.555372+0000","last_unstale":"2024-09-21T07:07:57.666452+0000","last_undegraded":"2024-09-21T07:07:57.666452+0000","last_fullsized":"2024-09-21T07:07:57.666452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:35.056919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:43.724990+0000","last_change":"2024-09-21T07:07:30.543196+0000","last_active":"2024-09-21T07:08:43.724990+0000","last_peered":"2024-09-21T07:08:43.724990+0000","last_clean":"2024-09-21T07:08:43.724990+0000","last_became_active":"2024-09-21T07:07:30.542755+0000","last_became_peered":"2024-09-21T07:07:30.542755+0000","last_unstale":"2024-09-21T07:08:43.724990+0000","last_undegraded":"2024-09-21T07:08:43.724990+0000","last_fullsized":"2024-09-21T07:08:43.724990+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:14.821703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665906+0000","last_change":"2024-09-21T07:07:32.561243+0000","last_active":"2024-09-21T07:07:57.665906+0000","last_peered":"2024-09-21T07:07:57.665906+0000","last_clean":"2024-09-21T07:07:57.665906+0000","last_became_active":"2024-09-21T07:07:32.560878+0000","last_became_peered":"2024-09-21T07:07:32.560878+0000","last_unstale":"2024-09-21T07:07:57.665906+0000","last_undegraded":"2024-09-21T07:07:57.665906+0000","last_fullsized":"2024-09-21T07:07:57.665906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:19.342422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664720+0000","last_change":"2024-09-21T07:07:30.754985+0000","last_active":"2024-09-21T07:07:57.664720+0000","last_peered":"2024-09-21T07:07:57.664720+0000","last_clean":"2024-09-21T07:07:57.664720+0000","last_became_active":"2024-09-21T07:07:30.754490+0000","last_became_peered":"2024-09-21T07:07:30.754490+0000","last_unstale":"2024-09-21T07:07:57.664720+0000","last_undegraded":"2024-09-21T07:07:57.664720+0000","last_fullsized":"2024-09-21T07:07:57.664720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:21.645643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667978+0000","last_change":"2024-09-21T07:07:32.567997+0000","last_active":"2024-09-21T07:07:57.667978+0000","last_peered":"2024-09-21T07:07:57.667978+0000","last_clean":"2024-09-21T07:07:57.667978+0000","last_became_active":"2024-09-21T07:07:32.567314+0000","last_became_peered":"2024-09-21T07:07:32.567314+0000","last_unstale":"2024-09-21T07:07:57.667978+0000","last_undegraded":"2024-09-21T07:07:57.667978+0000","last_fullsized":"2024-09-21T07:07:57.667978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:07.741967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.678889+0000","last_change":"2024-09-21T07:07:57.678175+0000","last_active":"2024-09-21T07:07:57.678889+0000","last_peered":"2024-09-21T07:07:57.678889+0000","last_clean":"2024-09-21T07:07:57.678889+0000","last_became_active":"2024-09-21T07:07:57.671137+0000","last_became_peered":"2024-09-21T07:07:57.671137+0000","last_unstale":"2024-09-21T07:07:57.678889+0000","last_undegraded":"2024-09-21T07:07:57.678889+0000","last_fullsized":"2024-09-21T07:07:57.678889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664423+0000","last_change":"2024-09-21T07:07:32.563380+0000","last_active":"2024-09-21T07:07:57.664423+0000","last_peered":"2024-09-21T07:07:57.664423+0000","last_clean":"2024-09-21T07:07:57.664423+0000","last_became_active":"2024-09-21T07:07:32.563012+0000","last_became_peered":"2024-09-21T07:07:32.563012+0000","last_unstale":"2024-09-21T07:07:57.664423+0000","last_undegraded":"2024-09-21T07:07:57.664423+0000","last_fullsized":"2024-09-21T07:07:57.664423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664634+0000","last_change":"2024-09-21T07:07:30.546448+0000","last_active":"2024-09-21T07:07:57.664634+0000","last_peered":"2024-09-21T07:07:57.664634+0000","last_clean":"2024-09-21T07:07:57.664634+0000","last_became_active":"2024-09-21T07:07:30.546015+0000","last_became_peered":"2024-09-21T07:07:30.546015+0000","last_unstale":"2024-09-21T07:07:57.664634+0000","last_undegraded":"2024-09-21T07:07:57.664634+0000","last_fullsized":"2024-09-21T07:07:57.664634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:23.041651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666630+0000","last_change":"2024-09-21T07:07:32.562533+0000","last_active":"2024-09-21T07:07:57.666630+0000","last_peered":"2024-09-21T07:07:57.666630+0000","last_clean":"2024-09-21T07:07:57.666630+0000","last_became_active":"2024-09-21T07:07:32.562101+0000","last_became_peered":"2024-09-21T07:07:32.562101+0000","last_unstale":"2024-09-21T07:07:57.666630+0000","last_undegraded":"2024-09-21T07:07:57.666630+0000","last_fullsized":"2024-09-21T07:07:57.666630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:49.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668720+0000","last_change":"2024-09-21T07:07:30.547263+0000","last_active":"2024-09-21T07:07:57.668720+0000","last_peered":"2024-09-21T07:07:57.668720+0000","last_clean":"2024-09-21T07:07:57.668720+0000","last_became_active":"2024-09-21T07:07:30.546874+0000","last_became_peered":"2024-09-21T07:07:30.546874+0000","last_unstale":"2024-09-21T07:07:57.668720+0000","last_undegraded":"2024-09-21T07:07:57.668720+0000","last_fullsized":"2024-09-21T07:07:57.668720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:18.545407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666337+0000","last_change":"2024-09-21T07:07:32.560288+0000","last_active":"2024-09-21T07:07:57.666337+0000","last_peered":"2024-09-21T07:07:57.666337+0000","last_clean":"2024-09-21T07:07:57.666337+0000","last_became_active":"2024-09-21T07:07:32.559938+0000","last_became_peered":"2024-09-21T07:07:32.559938+0000","last_unstale":"2024-09-21T07:07:57.666337+0000","last_undegraded":"2024-09-21T07:07:57.666337+0000","last_fullsized":"2024-09-21T07:07:57.666337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:55.531828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:46.740824+0000","last_change":"2024-09-21T07:07:30.754602+0000","last_active":"2024-09-21T07:08:46.740824+0000","last_peered":"2024-09-21T07:08:46.740824+0000","last_clean":"2024-09-21T07:08:46.740824+0000","last_became_active":"2024-09-21T07:07:30.754159+0000","last_became_peered":"2024-09-21T07:07:30.754159+0000","last_unstale":"2024-09-21T07:08:46.740824+0000","last_undegraded":"2024-09-21T07:08:46.740824+0000","last_fullsized":"2024-09-21T07:08:46.740824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666629+0000","last_change":"2024-09-21T07:07:32.557819+0000","last_active":"2024-09-21T07:07:57.666629+0000","last_peered":"2024-09-21T07:07:57.666629+0000","last_clean":"2024-09-21T07:07:57.666629+0000","last_became_active":"2024-09-21T07:07:32.557363+0000","last_became_peered":"2024-09-21T07:07:32.557363+0000","last_unstale":"2024-09-21T07:07:57.666629+0000","last_undegraded":"2024-09-21T07:07:57.666629+0000","last_fullsized":"2024-09-21T07:07:57.666629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.802658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666087+0000","last_change":"2024-09-21T07:06:20.138629+0000","last_active":"2024-09-21T07:07:57.666087+0000","last_peered":"2024-09-21T07:07:57.666087+0000","last_clean":"2024-09-21T07:07:57.666087+0000","last_became_active":"2024-09-21T07:06:20.132041+0000","last_became_peered":"2024-09-21T07:06:20.132041+0000","last_unstale":"2024-09-21T07:07:57.666087+0000","last_undegraded":"2024-09-21T07:07:57.666087+0000","last_fullsized":"2024-09-21T07:07:57.666087+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_clean_scrub_stamp":"2024-09-21T07:02:52.790893+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:41.784916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668277+0000","last_change":"2024-09-21T07:07:30.541638+0000","last_active":"2024-09-21T07:07:57.668277+0000","last_peered":"2024-09-21T07:07:57.668277+0000","last_clean":"2024-09-21T07:07:57.668277+0000","last_became_active":"2024-09-21T07:07:30.541185+0000","last_became_peered":"2024-09-21T07:07:30.541185+0000","last_unstale":"2024-09-21T07:07:57.668277+0000","last_undegraded":"2024-09-21T07:07:57.668277+0000","last_fullsized":"2024-09-21T07:07:57.668277+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:15.837077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668365+0000","last_change":"2024-09-21T07:07:32.560817+0000","last_active":"2024-09-21T07:07:57.668365+0000","last_peered":"2024-09-21T07:07:57.668365+0000","last_clean":"2024-09-21T07:07:57.668365+0000","last_became_active":"2024-09-21T07:07:32.560269+0000","last_became_peered":"2024-09-21T07:07:32.560269+0000","last_unstale":"2024-09-21T07:07:57.668365+0000","last_undegraded":"2024-09-21T07:07:57.668365+0000","last_fullsized":"2024-09-21T07:07:57.668365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:40.109644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666042+0000","last_change":"2024-09-21T07:07:30.543936+0000","last_active":"2024-09-21T07:07:57.666042+0000","last_peered":"2024-09-21T07:07:57.666042+0000","last_clean":"2024-09-21T07:07:57.666042+0000","last_became_active":"2024-09-21T07:07:30.543530+0000","last_became_peered":"2024-09-21T07:07:30.543530+0000","last_unstale":"2024-09-21T07:07:57.666042+0000","last_undegraded":"2024-09-21T07:07:57.666042+0000","last_fullsized":"2024-09-21T07:07:57.666042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:02.312471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663848+0000","last_change":"2024-09-21T07:07:32.542182+0000","last_active":"2024-09-21T07:07:57.663848+0000","last_peered":"2024-09-21T07:07:57.663848+0000","last_clean":"2024-09-21T07:07:57.663848+0000","last_became_active":"2024-09-21T07:07:32.541750+0000","last_became_peered":"2024-09-21T07:07:32.541750+0000","last_unstale":"2024-09-21T07:07:57.663848+0000","last_undegraded":"2024-09-21T07:07:57.663848+0000","last_fullsized":"2024-09-21T07:07:57.663848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.184712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":91,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:44.725827+0000","last_change":"2024-09-21T07:07:30.754978+0000","last_active":"2024-09-21T07:08:44.725827+0000","last_peered":"2024-09-21T07:08:44.725827+0000","last_clean":"2024-09-21T07:08:44.725827+0000","last_became_active":"2024-09-21T07:07:30.754149+0000","last_became_peered":"2024-09-21T07:07:30.754149+0000","last_unstale":"2024-09-21T07:08:44.725827+0000","last_undegraded":"2024-09-21T07:08:44.725827+0000","last_fullsized":"2024-09-21T07:08:44.725827+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:36.140237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668604+0000","last_change":"2024-09-21T07:07:32.570424+0000","last_active":"2024-09-21T07:07:57.668604+0000","last_peered":"2024-09-21T07:07:57.668604+0000","last_clean":"2024-09-21T07:07:57.668604+0000","last_became_active":"2024-09-21T07:07:32.570029+0000","last_became_peered":"2024-09-21T07:07:32.570029+0000","last_unstale":"2024-09-21T07:07:57.668604+0000","last_undegraded":"2024-09-21T07:07:57.668604+0000","last_fullsized":"2024-09-21T07:07:57.668604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:09.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:44.725337+0000","last_change":"2024-09-21T07:07:30.543963+0000","last_active":"2024-09-21T07:08:44.725337+0000","last_peered":"2024-09-21T07:08:44.725337+0000","last_clean":"2024-09-21T07:08:44.725337+0000","last_became_active":"2024-09-21T07:07:30.543586+0000","last_became_peered":"2024-09-21T07:07:30.543586+0000","last_unstale":"2024-09-21T07:08:44.725337+0000","last_undegraded":"2024-09-21T07:08:44.725337+0000","last_fullsized":"2024-09-21T07:08:44.725337+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:05.782005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662307+0000","last_change":"2024-09-21T07:07:32.556132+0000","last_active":"2024-09-21T07:07:57.662307+0000","last_peered":"2024-09-21T07:07:57.662307+0000","last_clean":"2024-09-21T07:07:57.662307+0000","last_became_active":"2024-09-21T07:07:32.555717+0000","last_became_peered":"2024-09-21T07:07:32.555717+0000","last_unstale":"2024-09-21T07:07:57.662307+0000","last_undegraded":"2024-09-21T07:07:57.662307+0000","last_fullsized":"2024-09-21T07:07:57.662307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.809268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661088+0000","last_change":"2024-09-21T07:07:30.755143+0000","last_active":"2024-09-21T07:07:57.661088+0000","last_peered":"2024-09-21T07:07:57.661088+0000","last_clean":"2024-09-21T07:07:57.661088+0000","last_became_active":"2024-09-21T07:07:30.754591+0000","last_became_peered":"2024-09-21T07:07:30.754591+0000","last_unstale":"2024-09-21T07:07:57.661088+0000","last_undegraded":"2024-09-21T07:07:57.661088+0000","last_fullsized":"2024-09-21T07:07:57.661088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:13.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662201+0000","last_change":"2024-09-21T07:07:32.552869+0000","last_active":"2024-09-21T07:07:57.662201+0000","last_peered":"2024-09-21T07:07:57.662201+0000","last_clean":"2024-09-21T07:07:57.662201+0000","last_became_active":"2024-09-21T07:07:32.552483+0000","last_became_peered":"2024-09-21T07:07:32.552483+0000","last_unstale":"2024-09-21T07:07:57.662201+0000","last_undegraded":"2024-09-21T07:07:57.662201+0000","last_fullsized":"2024-09-21T07:07:57.662201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:21.006847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665762+0000","last_change":"2024-09-21T07:07:30.755552+0000","last_active":"2024-09-21T07:07:57.665762+0000","last_peered":"2024-09-21T07:07:57.665762+0000","last_clean":"2024-09-21T07:07:57.665762+0000","last_became_active":"2024-09-21T07:07:30.754451+0000","last_became_peered":"2024-09-21T07:07:30.754451+0000","last_unstale":"2024-09-21T07:07:57.665762+0000","last_undegraded":"2024-09-21T07:07:57.665762+0000","last_fullsized":"2024-09-21T07:07:57.665762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:50.229649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664284+0000","last_change":"2024-09-21T07:07:32.543249+0000","last_active":"2024-09-21T07:07:57.664284+0000","last_peered":"2024-09-21T07:07:57.664284+0000","last_clean":"2024-09-21T07:07:57.664284+0000","last_became_active":"2024-09-21T07:07:32.542866+0000","last_became_peered":"2024-09-21T07:07:32.542866+0000","last_unstale":"2024-09-21T07:07:57.664284+0000","last_undegraded":"2024-09-21T07:07:57.664284+0000","last_fullsized":"2024-09-21T07:07:57.664284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:29.476454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661340+0000","last_change":"2024-09-21T07:07:30.541589+0000","last_active":"2024-09-21T07:07:57.661340+0000","last_peered":"2024-09-21T07:07:57.661340+0000","last_clean":"2024-09-21T07:07:57.661340+0000","last_became_active":"2024-09-21T07:07:30.541171+0000","last_became_peered":"2024-09-21T07:07:30.541171+0000","last_unstale":"2024-09-21T07:07:57.661340+0000","last_undegraded":"2024-09-21T07:07:57.661340+0000","last_fullsized":"2024-09-21T07:07:57.661340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:46.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668335+0000","last_change":"2024-09-21T07:07:32.558409+0000","last_active":"2024-09-21T07:07:57.668335+0000","last_peered":"2024-09-21T07:07:57.668335+0000","last_clean":"2024-09-21T07:07:57.668335+0000","last_became_active":"2024-09-21T07:07:32.557886+0000","last_became_peered":"2024-09-21T07:07:32.557886+0000","last_unstale":"2024-09-21T07:07:57.668335+0000","last_undegraded":"2024-09-21T07:07:57.668335+0000","last_fullsized":"2024-09-21T07:07:57.668335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.071651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668890+0000","last_change":"2024-09-21T07:07:30.536107+0000","last_active":"2024-09-21T07:07:57.668890+0000","last_peered":"2024-09-21T07:07:57.668890+0000","last_clean":"2024-09-21T07:07:57.668890+0000","last_became_active":"2024-09-21T07:07:30.535455+0000","last_became_peered":"2024-09-21T07:07:30.535455+0000","last_unstale":"2024-09-21T07:07:57.668890+0000","last_undegraded":"2024-09-21T07:07:57.668890+0000","last_fullsized":"2024-09-21T07:07:57.668890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:55.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700974+0000","last_change":"2024-09-21T07:07:32.553187+0000","last_active":"2024-09-21T07:07:57.700974+0000","last_peered":"2024-09-21T07:07:57.700974+0000","last_clean":"2024-09-21T07:07:57.700974+0000","last_became_active":"2024-09-21T07:07:32.552905+0000","last_became_peered":"2024-09-21T07:07:32.552905+0000","last_unstale":"2024-09-21T07:07:57.700974+0000","last_undegraded":"2024-09-21T07:07:57.700974+0000","last_fullsized":"2024-09-21T07:07:57.700974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:24.790329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670080+0000","last_change":"2024-09-21T07:07:30.754858+0000","last_active":"2024-09-21T07:07:57.670080+0000","last_peered":"2024-09-21T07:07:57.670080+0000","last_clean":"2024-09-21T07:07:57.670080+0000","last_became_active":"2024-09-21T07:07:30.754483+0000","last_became_peered":"2024-09-21T07:07:30.754483+0000","last_unstale":"2024-09-21T07:07:57.670080+0000","last_undegraded":"2024-09-21T07:07:57.670080+0000","last_fullsized":"2024-09-21T07:07:57.670080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:29.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664984+0000","last_change":"2024-09-21T07:07:32.562213+0000","last_active":"2024-09-21T07:07:57.664984+0000","last_peered":"2024-09-21T07:07:57.664984+0000","last_clean":"2024-09-21T07:07:57.664984+0000","last_became_active":"2024-09-21T07:07:32.561834+0000","last_became_peered":"2024-09-21T07:07:32.561834+0000","last_unstale":"2024-09-21T07:07:57.664984+0000","last_undegraded":"2024-09-21T07:07:57.664984+0000","last_fullsized":"2024-09-21T07:07:57.664984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:12.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668009+0000","last_change":"2024-09-21T07:07:30.543455+0000","last_active":"2024-09-21T07:07:57.668009+0000","last_peered":"2024-09-21T07:07:57.668009+0000","last_clean":"2024-09-21T07:07:57.668009+0000","last_became_active":"2024-09-21T07:07:30.543059+0000","last_became_peered":"2024-09-21T07:07:30.543059+0000","last_unstale":"2024-09-21T07:07:57.668009+0000","last_undegraded":"2024-09-21T07:07:57.668009+0000","last_fullsized":"2024-09-21T07:07:57.668009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.896121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664245+0000","last_change":"2024-09-21T07:07:32.560600+0000","last_active":"2024-09-21T07:07:57.664245+0000","last_peered":"2024-09-21T07:07:57.664245+0000","last_clean":"2024-09-21T07:07:57.664245+0000","last_became_active":"2024-09-21T07:07:32.560159+0000","last_became_peered":"2024-09-21T07:07:32.560159+0000","last_unstale":"2024-09-21T07:07:57.664245+0000","last_undegraded":"2024-09-21T07:07:57.664245+0000","last_fullsized":"2024-09-21T07:07:57.664245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.228180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.683341+0000","last_change":"2024-09-21T07:07:57.682685+0000","last_active":"2024-09-21T07:07:57.683341+0000","last_peered":"2024-09-21T07:07:57.683341+0000","last_clean":"2024-09-21T07:07:57.683341+0000","last_became_active":"2024-09-21T07:07:57.671259+0000","last_became_peered":"2024-09-21T07:07:57.671259+0000","last_unstale":"2024-09-21T07:07:57.683341+0000","last_undegraded":"2024-09-21T07:07:57.683341+0000","last_fullsized":"2024-09-21T07:07:57.683341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668076+0000","last_change":"2024-09-21T07:07:32.554033+0000","last_active":"2024-09-21T07:07:57.668076+0000","last_peered":"2024-09-21T07:07:57.668076+0000","last_clean":"2024-09-21T07:07:57.668076+0000","last_became_active":"2024-09-21T07:07:32.553654+0000","last_became_peered":"2024-09-21T07:07:32.553654+0000","last_unstale":"2024-09-21T07:07:57.668076+0000","last_undegraded":"2024-09-21T07:07:57.668076+0000","last_fullsized":"2024-09-21T07:07:57.668076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:15.876104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665390+0000","last_change":"2024-09-21T07:07:30.547818+0000","last_active":"2024-09-21T07:07:57.665390+0000","last_peered":"2024-09-21T07:07:57.665390+0000","last_clean":"2024-09-21T07:07:57.665390+0000","last_became_active":"2024-09-21T07:07:30.547387+0000","last_became_peered":"2024-09-21T07:07:30.547387+0000","last_unstale":"2024-09-21T07:07:57.665390+0000","last_undegraded":"2024-09-21T07:07:57.665390+0000","last_fullsized":"2024-09-21T07:07:57.665390+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666216+0000","last_change":"2024-09-21T07:07:32.566731+0000","last_active":"2024-09-21T07:07:57.666216+0000","last_peered":"2024-09-21T07:07:57.666216+0000","last_clean":"2024-09-21T07:07:57.666216+0000","last_became_active":"2024-09-21T07:07:32.566233+0000","last_became_peered":"2024-09-21T07:07:32.566233+0000","last_unstale":"2024-09-21T07:07:57.666216+0000","last_undegraded":"2024-09-21T07:07:57.666216+0000","last_fullsized":"2024-09-21T07:07:57.666216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:57.630088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.673727+0000","last_change":"2024-09-21T07:07:57.673550+0000","last_active":"2024-09-21T07:07:57.673727+0000","last_peered":"2024-09-21T07:07:57.673727+0000","last_clean":"2024-09-21T07:07:57.673727+0000","last_became_active":"2024-09-21T07:07:57.673036+0000","last_became_peered":"2024-09-21T07:07:57.673036+0000","last_unstale":"2024-09-21T07:07:57.673727+0000","last_undegraded":"2024-09-21T07:07:57.673727+0000","last_fullsized":"2024-09-21T07:07:57.673727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:53.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665716+0000","last_change":"2024-09-21T07:07:30.544884+0000","last_active":"2024-09-21T07:07:57.665716+0000","last_peered":"2024-09-21T07:07:57.665716+0000","last_clean":"2024-09-21T07:07:57.665716+0000","last_became_active":"2024-09-21T07:07:30.543321+0000","last_became_peered":"2024-09-21T07:07:30.543321+0000","last_unstale":"2024-09-21T07:07:57.665716+0000","last_undegraded":"2024-09-21T07:07:57.665716+0000","last_fullsized":"2024-09-21T07:07:57.665716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.234905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670015+0000","last_change":"2024-09-21T07:07:32.566124+0000","last_active":"2024-09-21T07:07:57.670015+0000","last_peered":"2024-09-21T07:07:57.670015+0000","last_clean":"2024-09-21T07:07:57.670015+0000","last_became_active":"2024-09-21T07:07:32.565743+0000","last_became_peered":"2024-09-21T07:07:32.565743+0000","last_unstale":"2024-09-21T07:07:57.670015+0000","last_undegraded":"2024-09-21T07:07:57.670015+0000","last_fullsized":"2024-09-21T07:07:57.670015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:57.048529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665685+0000","last_change":"2024-09-21T07:07:30.546742+0000","last_active":"2024-09-21T07:07:57.665685+0000","last_peered":"2024-09-21T07:07:57.665685+0000","last_clean":"2024-09-21T07:07:57.665685+0000","last_became_active":"2024-09-21T07:07:30.546300+0000","last_became_peered":"2024-09-21T07:07:30.546300+0000","last_unstale":"2024-09-21T07:07:57.665685+0000","last_undegraded":"2024-09-21T07:07:57.665685+0000","last_fullsized":"2024-09-21T07:07:57.665685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:58.903582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701061+0000","last_change":"2024-09-21T07:07:32.565602+0000","last_active":"2024-09-21T07:07:57.701061+0000","last_peered":"2024-09-21T07:07:57.701061+0000","last_clean":"2024-09-21T07:07:57.701061+0000","last_became_active":"2024-09-21T07:07:32.565252+0000","last_became_peered":"2024-09-21T07:07:32.565252+0000","last_unstale":"2024-09-21T07:07:57.701061+0000","last_undegraded":"2024-09-21T07:07:57.701061+0000","last_fullsized":"2024-09-21T07:07:57.701061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:50.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668572+0000","last_change":"2024-09-21T07:07:30.754535+0000","last_active":"2024-09-21T07:07:57.668572+0000","last_peered":"2024-09-21T07:07:57.668572+0000","last_clean":"2024-09-21T07:07:57.668572+0000","last_became_active":"2024-09-21T07:07:30.754129+0000","last_became_peered":"2024-09-21T07:07:30.754129+0000","last_unstale":"2024-09-21T07:07:57.668572+0000","last_undegraded":"2024-09-21T07:07:57.668572+0000","last_fullsized":"2024-09-21T07:07:57.668572+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:23.800713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668229+0000","last_change":"2024-09-21T07:07:32.561210+0000","last_active":"2024-09-21T07:07:57.668229+0000","last_peered":"2024-09-21T07:07:57.668229+0000","last_clean":"2024-09-21T07:07:57.668229+0000","last_became_active":"2024-09-21T07:07:32.560850+0000","last_became_peered":"2024-09-21T07:07:32.560850+0000","last_unstale":"2024-09-21T07:07:57.668229+0000","last_undegraded":"2024-09-21T07:07:57.668229+0000","last_fullsized":"2024-09-21T07:07:57.668229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.212097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":100,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:45.726040+0000","last_change":"2024-09-21T07:07:30.543778+0000","last_active":"2024-09-21T07:08:45.726040+0000","last_peered":"2024-09-21T07:08:45.726040+0000","last_clean":"2024-09-21T07:08:45.726040+0000","last_became_active":"2024-09-21T07:07:30.543474+0000","last_became_peered":"2024-09-21T07:07:30.543474+0000","last_unstale":"2024-09-21T07:08:45.726040+0000","last_undegraded":"2024-09-21T07:08:45.726040+0000","last_fullsized":"2024-09-21T07:08:45.726040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:06.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72352,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":675,"num_read_kb":418,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":217056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808861,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":395386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972386,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40992,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704160,"statfs":{"total":95995035648,"available":95953059840,"internally_reserved":0,"allocated":1523712,"data_stored":1051150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135910,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":394903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332140,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":395259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528369,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1437696,"data_stored":988190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691894,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":395011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888123,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1449984,"data_stored":987086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018944,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":394872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":394445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":460901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":460681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40340,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704812,"statfs":{"total":95995035648,"available":95953727488,"internally_reserved":0,"allocated":847872,"data_stored":396350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:08:52.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T07:08:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:53.099 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:52 smithi029 ceph-mon[30983]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:53.099 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:52 smithi029 ceph-mon[30983]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:08:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:52 smithi066 ceph-mon[34793]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:53.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:52 smithi066 ceph-mon[34793]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:08:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:52 smithi052 ceph-mon[34308]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:53.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:52 smithi052 ceph-mon[34308]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 -- 172.21.15.29:0/3417104488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc440108d10 msgr2=0x7fc44010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 --2- 172.21.15.29:0/3417104488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc440108d10 0x7fc44010f540 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc438009ca0 tx=0x7fc43802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 -- 172.21.15.29:0/3417104488 shutdown_connections 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 --2- 172.21.15.29:0/3417104488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc440108d10 0x7fc44010f540 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 --2- 172.21.15.29:0/3417104488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4401083c0 0x7fc4401087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 --2- 172.21.15.29:0/3417104488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc440102a80 0x7fc440102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 -- 172.21.15.29:0/3417104488 >> 172.21.15.29:0/3417104488 conn(0x7fc440079740 msgr2=0x7fc440079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 -- 172.21.15.29:0/3417104488 shutdown_connections 2024-09-21T07:08:53.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.325+0000 7fc445cfe640 1 -- 172.21.15.29:0/3417104488 wait complete. 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 Processor -- start 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 -- start start 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc440102a80 0x7fc440105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4401083c0 0x7fc440105640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc440108d10 0x7fc440105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc4401129e0 con 0x7fc4401083c0 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc440112860 con 0x7fc440102a80 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc445cfe640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc440112b60 con 0x7fc440108d10 2024-09-21T07:08:53.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc43effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4401083c0 0x7fc440105640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc43effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4401083c0 0x7fc440105640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48678/0 (socket says 172.21.15.29:48678) 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc43effd640 1 -- 172.21.15.29:0/2256703682 learned_addr learned my addr 172.21.15.29:0/2256703682 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc43f7fe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc440102a80 0x7fc440105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.326+0000 7fc43ffff640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc440108d10 0x7fc440105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43effd640 1 -- 172.21.15.29:0/2256703682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc440108d10 msgr2=0x7fc440105b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43effd640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc440108d10 0x7fc440105b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43effd640 1 -- 172.21.15.29:0/2256703682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc440102a80 msgr2=0x7fc440105100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43effd640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc440102a80 0x7fc440105100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43effd640 1 -- 172.21.15.29:0/2256703682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4401a8690 con 0x7fc4401083c0 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43effd640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4401083c0 0x7fc440105640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc43400c9a0 tx=0x7fc43400cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43cff9640 1 -- 172.21.15.29:0/2256703682 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434014070 con 0x7fc4401083c0 2024-09-21T07:08:53.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43cff9640 1 -- 172.21.15.29:0/2256703682 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc434004440 con 0x7fc4401083c0 2024-09-21T07:08:53.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4401a8980 con 0x7fc4401083c0 2024-09-21T07:08:53.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc43cff9640 1 -- 172.21.15.29:0/2256703682 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434003d70 con 0x7fc4401083c0 2024-09-21T07:08:53.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.327+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4401a8f40 con 0x7fc4401083c0 2024-09-21T07:08:53.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.328+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc440103d00 con 0x7fc4401083c0 2024-09-21T07:08:53.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.330+0000 7fc43cff9640 1 -- 172.21.15.29:0/2256703682 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc434017070 con 0x7fc4401083c0 2024-09-21T07:08:53.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.330+0000 7fc43cff9640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc4280b65a0 0x7fc4280b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:53.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.331+0000 7fc43f7fe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc4280b65a0 0x7fc4280b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:53.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.331+0000 7fc43cff9640 1 -- 172.21.15.29:0/2256703682 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc4340e7650 con 0x7fc4401083c0 2024-09-21T07:08:53.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.331+0000 7fc43f7fe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc4280b65a0 0x7fc4280b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc440106b50 tx=0x7fc430009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:53.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.334+0000 7fc43cff9640 1 -- 172.21.15.29:0/2256703682 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc43401e020 con 0x7fc4401083c0 2024-09-21T07:08:53.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.519+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc440063800 con 0x7fc4280b65a0 2024-09-21T07:08:53.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.523+0000 7fc43cff9640 1 -- 172.21.15.29:0/2256703682 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258749 (secure 0 0 0) 0x7fc440063800 con 0x7fc4280b65a0 2024-09-21T07:08:53.527 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:53.528 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc4280b65a0 msgr2=0x7fc4280b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc4280b65a0 0x7fc4280b8ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc440106b50 tx=0x7fc430009110 comp rx=0 tx=0).stop 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4401083c0 msgr2=0x7fc440105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4401083c0 0x7fc440105640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc43400c9a0 tx=0x7fc43400cda0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 shutdown_connections 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc4280b65a0 0x7fc4280b8ab0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc440108d10 0x7fc440105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc4401083c0 0x7fc440105640 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 --2- 172.21.15.29:0/2256703682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc440102a80 0x7fc440105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 >> 172.21.15.29:0/2256703682 conn(0x7fc440079740 msgr2=0x7fc44006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.526+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 shutdown_connections 2024-09-21T07:08:53.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:53.527+0000 7fc445cfe640 1 -- 172.21.15.29:0/2256703682 wait complete. 2024-09-21T07:08:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:53 smithi066 ceph-mon[34793]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:53 smithi029 ceph-mon[30983]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:54.242 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:53 smithi052 ceph-mon[34308]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T07:08:54.294 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-21T07:08:52.027158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662954,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":770,"num_read_kb":487,"num_write":371,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386052,"kb_used_data":11784,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555772,"statfs":{"total":1151940427776,"available":1151545110528,"internally_reserved":0,"allocated":12066816,"data_stored":6714234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003117"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665830+0000","last_change":"2024-09-21T07:07:32.566786+0000","last_active":"2024-09-21T07:07:57.665830+0000","last_peered":"2024-09-21T07:07:57.665830+0000","last_clean":"2024-09-21T07:07:57.665830+0000","last_became_active":"2024-09-21T07:07:32.565722+0000","last_became_peered":"2024-09-21T07:07:32.565722+0000","last_unstale":"2024-09-21T07:07:57.665830+0000","last_undegraded":"2024-09-21T07:07:57.665830+0000","last_fullsized":"2024-09-21T07:07:57.665830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:22.389773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700880+0000","last_change":"2024-09-21T07:07:32.556460+0000","last_active":"2024-09-21T07:07:57.700880+0000","last_peered":"2024-09-21T07:07:57.700880+0000","last_clean":"2024-09-21T07:07:57.700880+0000","last_became_active":"2024-09-21T07:07:32.555738+0000","last_became_peered":"2024-09-21T07:07:32.555738+0000","last_unstale":"2024-09-21T07:07:57.700880+0000","last_undegraded":"2024-09-21T07:07:57.700880+0000","last_fullsized":"2024-09-21T07:07:57.700880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:04.921413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700779+0000","last_change":"2024-09-21T07:07:32.565814+0000","last_active":"2024-09-21T07:07:57.700779+0000","last_peered":"2024-09-21T07:07:57.700779+0000","last_clean":"2024-09-21T07:07:57.700779+0000","last_became_active":"2024-09-21T07:07:32.565401+0000","last_became_peered":"2024-09-21T07:07:32.565401+0000","last_unstale":"2024-09-21T07:07:57.700779+0000","last_undegraded":"2024-09-21T07:07:57.700779+0000","last_fullsized":"2024-09-21T07:07:57.700779+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:56.705903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668559+0000","last_change":"2024-09-21T07:07:32.554713+0000","last_active":"2024-09-21T07:07:57.668559+0000","last_peered":"2024-09-21T07:07:57.668559+0000","last_clean":"2024-09-21T07:07:57.668559+0000","last_became_active":"2024-09-21T07:07:32.554203+0000","last_became_peered":"2024-09-21T07:07:32.554203+0000","last_unstale":"2024-09-21T07:07:57.668559+0000","last_undegraded":"2024-09-21T07:07:57.668559+0000","last_fullsized":"2024-09-21T07:07:57.668559+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:29.687716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665134+0000","last_change":"2024-09-21T07:07:32.566048+0000","last_active":"2024-09-21T07:07:57.665134+0000","last_peered":"2024-09-21T07:07:57.665134+0000","last_clean":"2024-09-21T07:07:57.665134+0000","last_became_active":"2024-09-21T07:07:32.565659+0000","last_became_peered":"2024-09-21T07:07:32.565659+0000","last_unstale":"2024-09-21T07:07:57.665134+0000","last_undegraded":"2024-09-21T07:07:57.665134+0000","last_fullsized":"2024-09-21T07:07:57.665134+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:56.987620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662196+0000","last_change":"2024-09-21T07:07:32.550492+0000","last_active":"2024-09-21T07:07:57.662196+0000","last_peered":"2024-09-21T07:07:57.662196+0000","last_clean":"2024-09-21T07:07:57.662196+0000","last_became_active":"2024-09-21T07:07:32.549691+0000","last_became_peered":"2024-09-21T07:07:32.549691+0000","last_unstale":"2024-09-21T07:07:57.662196+0000","last_undegraded":"2024-09-21T07:07:57.662196+0000","last_fullsized":"2024-09-21T07:07:57.662196+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:29.890164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665985+0000","last_change":"2024-09-21T07:07:32.560258+0000","last_active":"2024-09-21T07:07:57.665985+0000","last_peered":"2024-09-21T07:07:57.665985+0000","last_clean":"2024-09-21T07:07:57.665985+0000","last_became_active":"2024-09-21T07:07:32.559890+0000","last_became_peered":"2024-09-21T07:07:32.559890+0000","last_unstale":"2024-09-21T07:07:57.665985+0000","last_undegraded":"2024-09-21T07:07:57.665985+0000","last_fullsized":"2024-09-21T07:07:57.665985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:41.794736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667805+0000","last_change":"2024-09-21T07:07:32.560923+0000","last_active":"2024-09-21T07:07:57.667805+0000","last_peered":"2024-09-21T07:07:57.667805+0000","last_clean":"2024-09-21T07:07:57.667805+0000","last_became_active":"2024-09-21T07:07:32.560509+0000","last_became_peered":"2024-09-21T07:07:32.560509+0000","last_unstale":"2024-09-21T07:07:57.667805+0000","last_undegraded":"2024-09-21T07:07:57.667805+0000","last_fullsized":"2024-09-21T07:07:57.667805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:59.576434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670812+0000","last_change":"2024-09-21T07:07:32.564475+0000","last_active":"2024-09-21T07:07:57.670812+0000","last_peered":"2024-09-21T07:07:57.670812+0000","last_clean":"2024-09-21T07:07:57.670812+0000","last_became_active":"2024-09-21T07:07:32.564115+0000","last_became_peered":"2024-09-21T07:07:32.564115+0000","last_unstale":"2024-09-21T07:07:57.670812+0000","last_undegraded":"2024-09-21T07:07:57.670812+0000","last_fullsized":"2024-09-21T07:07:57.670812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:03.989109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662889+0000","last_change":"2024-09-21T07:07:32.557377+0000","last_active":"2024-09-21T07:07:57.662889+0000","last_peered":"2024-09-21T07:07:57.662889+0000","last_clean":"2024-09-21T07:07:57.662889+0000","last_became_active":"2024-09-21T07:07:32.556732+0000","last_became_peered":"2024-09-21T07:07:32.556732+0000","last_unstale":"2024-09-21T07:07:57.662889+0000","last_undegraded":"2024-09-21T07:07:57.662889+0000","last_fullsized":"2024-09-21T07:07:57.662889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:32.474690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666465+0000","last_change":"2024-09-21T07:07:32.558691+0000","last_active":"2024-09-21T07:07:57.666465+0000","last_peered":"2024-09-21T07:07:57.666465+0000","last_clean":"2024-09-21T07:07:57.666465+0000","last_became_active":"2024-09-21T07:07:32.558029+0000","last_became_peered":"2024-09-21T07:07:32.558029+0000","last_unstale":"2024-09-21T07:07:57.666465+0000","last_undegraded":"2024-09-21T07:07:57.666465+0000","last_fullsized":"2024-09-21T07:07:57.666465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:27.378786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668606+0000","last_change":"2024-09-21T07:07:32.556500+0000","last_active":"2024-09-21T07:07:57.668606+0000","last_peered":"2024-09-21T07:07:57.668606+0000","last_clean":"2024-09-21T07:07:57.668606+0000","last_became_active":"2024-09-21T07:07:32.555529+0000","last_became_peered":"2024-09-21T07:07:32.555529+0000","last_unstale":"2024-09-21T07:07:57.668606+0000","last_undegraded":"2024-09-21T07:07:57.668606+0000","last_fullsized":"2024-09-21T07:07:57.668606+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:19.494498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664151+0000","last_change":"2024-09-21T07:07:32.560235+0000","last_active":"2024-09-21T07:07:57.664151+0000","last_peered":"2024-09-21T07:07:57.664151+0000","last_clean":"2024-09-21T07:07:57.664151+0000","last_became_active":"2024-09-21T07:07:32.559834+0000","last_became_peered":"2024-09-21T07:07:32.559834+0000","last_unstale":"2024-09-21T07:07:57.664151+0000","last_undegraded":"2024-09-21T07:07:57.664151+0000","last_fullsized":"2024-09-21T07:07:57.664151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:37:30.090878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700558+0000","last_change":"2024-09-21T07:07:32.554158+0000","last_active":"2024-09-21T07:07:57.700558+0000","last_peered":"2024-09-21T07:07:57.700558+0000","last_clean":"2024-09-21T07:07:57.700558+0000","last_became_active":"2024-09-21T07:07:32.553837+0000","last_became_peered":"2024-09-21T07:07:32.553837+0000","last_unstale":"2024-09-21T07:07:57.700558+0000","last_undegraded":"2024-09-21T07:07:57.700558+0000","last_fullsized":"2024-09-21T07:07:57.700558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:23.845629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700519+0000","last_change":"2024-09-21T07:07:32.556921+0000","last_active":"2024-09-21T07:07:57.700519+0000","last_peered":"2024-09-21T07:07:57.700519+0000","last_clean":"2024-09-21T07:07:57.700519+0000","last_became_active":"2024-09-21T07:07:32.556529+0000","last_became_peered":"2024-09-21T07:07:32.556529+0000","last_unstale":"2024-09-21T07:07:57.700519+0000","last_undegraded":"2024-09-21T07:07:57.700519+0000","last_fullsized":"2024-09-21T07:07:57.700519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:11.447617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669857+0000","last_change":"2024-09-21T07:07:32.567572+0000","last_active":"2024-09-21T07:07:57.669857+0000","last_peered":"2024-09-21T07:07:57.669857+0000","last_clean":"2024-09-21T07:07:57.669857+0000","last_became_active":"2024-09-21T07:07:32.567159+0000","last_became_peered":"2024-09-21T07:07:32.567159+0000","last_unstale":"2024-09-21T07:07:57.669857+0000","last_undegraded":"2024-09-21T07:07:57.669857+0000","last_fullsized":"2024-09-21T07:07:57.669857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:07.316539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665990+0000","last_change":"2024-09-21T07:07:32.567213+0000","last_active":"2024-09-21T07:07:57.665990+0000","last_peered":"2024-09-21T07:07:57.665990+0000","last_clean":"2024-09-21T07:07:57.665990+0000","last_became_active":"2024-09-21T07:07:32.566284+0000","last_became_peered":"2024-09-21T07:07:32.566284+0000","last_unstale":"2024-09-21T07:07:57.665990+0000","last_undegraded":"2024-09-21T07:07:57.665990+0000","last_fullsized":"2024-09-21T07:07:57.665990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:42.011402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661267+0000","last_change":"2024-09-21T07:07:32.551695+0000","last_active":"2024-09-21T07:07:57.661267+0000","last_peered":"2024-09-21T07:07:57.661267+0000","last_clean":"2024-09-21T07:07:57.661267+0000","last_became_active":"2024-09-21T07:07:32.551282+0000","last_became_peered":"2024-09-21T07:07:32.551282+0000","last_unstale":"2024-09-21T07:07:57.661267+0000","last_undegraded":"2024-09-21T07:07:57.661267+0000","last_fullsized":"2024-09-21T07:07:57.661267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:33.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669799+0000","last_change":"2024-09-21T07:07:32.551000+0000","last_active":"2024-09-21T07:07:57.669799+0000","last_peered":"2024-09-21T07:07:57.669799+0000","last_clean":"2024-09-21T07:07:57.669799+0000","last_became_active":"2024-09-21T07:07:32.550590+0000","last_became_peered":"2024-09-21T07:07:32.550590+0000","last_unstale":"2024-09-21T07:07:57.669799+0000","last_undegraded":"2024-09-21T07:07:57.669799+0000","last_fullsized":"2024-09-21T07:07:57.669799+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:30.213470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668399+0000","last_change":"2024-09-21T07:07:57.668284+0000","last_active":"2024-09-21T07:07:57.668399+0000","last_peered":"2024-09-21T07:07:57.668399+0000","last_clean":"2024-09-21T07:07:57.668399+0000","last_became_active":"2024-09-21T07:07:57.667145+0000","last_became_peered":"2024-09-21T07:07:57.667145+0000","last_unstale":"2024-09-21T07:07:57.668399+0000","last_undegraded":"2024-09-21T07:07:57.668399+0000","last_fullsized":"2024-09-21T07:07:57.668399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:12:11.662321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664164+0000","last_change":"2024-09-21T07:07:32.555752+0000","last_active":"2024-09-21T07:07:57.664164+0000","last_peered":"2024-09-21T07:07:57.664164+0000","last_clean":"2024-09-21T07:07:57.664164+0000","last_became_active":"2024-09-21T07:07:32.555057+0000","last_became_peered":"2024-09-21T07:07:32.555057+0000","last_unstale":"2024-09-21T07:07:57.664164+0000","last_undegraded":"2024-09-21T07:07:57.664164+0000","last_fullsized":"2024-09-21T07:07:57.664164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:10:03.161990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670600+0000","last_change":"2024-09-21T07:07:32.555589+0000","last_active":"2024-09-21T07:07:57.670600+0000","last_peered":"2024-09-21T07:07:57.670600+0000","last_clean":"2024-09-21T07:07:57.670600+0000","last_became_active":"2024-09-21T07:07:32.555037+0000","last_became_peered":"2024-09-21T07:07:32.555037+0000","last_unstale":"2024-09-21T07:07:57.670600+0000","last_undegraded":"2024-09-21T07:07:57.670600+0000","last_fullsized":"2024-09-21T07:07:57.670600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:25.346546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667780+0000","last_change":"2024-09-21T07:07:32.559407+0000","last_active":"2024-09-21T07:07:57.667780+0000","last_peered":"2024-09-21T07:07:57.667780+0000","last_clean":"2024-09-21T07:07:57.667780+0000","last_became_active":"2024-09-21T07:07:32.559112+0000","last_became_peered":"2024-09-21T07:07:32.559112+0000","last_unstale":"2024-09-21T07:07:57.667780+0000","last_undegraded":"2024-09-21T07:07:57.667780+0000","last_fullsized":"2024-09-21T07:07:57.667780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:13.970511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669197+0000","last_change":"2024-09-21T07:07:32.564798+0000","last_active":"2024-09-21T07:07:57.669197+0000","last_peered":"2024-09-21T07:07:57.669197+0000","last_clean":"2024-09-21T07:07:57.669197+0000","last_became_active":"2024-09-21T07:07:32.564381+0000","last_became_peered":"2024-09-21T07:07:32.564381+0000","last_unstale":"2024-09-21T07:07:57.669197+0000","last_undegraded":"2024-09-21T07:07:57.669197+0000","last_fullsized":"2024-09-21T07:07:57.669197+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:19.667252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668233+0000","last_change":"2024-09-21T07:07:32.555274+0000","last_active":"2024-09-21T07:07:57.668233+0000","last_peered":"2024-09-21T07:07:57.668233+0000","last_clean":"2024-09-21T07:07:57.668233+0000","last_became_active":"2024-09-21T07:07:32.554816+0000","last_became_peered":"2024-09-21T07:07:32.554816+0000","last_unstale":"2024-09-21T07:07:57.668233+0000","last_undegraded":"2024-09-21T07:07:57.668233+0000","last_fullsized":"2024-09-21T07:07:57.668233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:46.018974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.671064+0000","last_change":"2024-09-21T07:07:32.555655+0000","last_active":"2024-09-21T07:07:57.671064+0000","last_peered":"2024-09-21T07:07:57.671064+0000","last_clean":"2024-09-21T07:07:57.671064+0000","last_became_active":"2024-09-21T07:07:32.555240+0000","last_became_peered":"2024-09-21T07:07:32.555240+0000","last_unstale":"2024-09-21T07:07:57.671064+0000","last_undegraded":"2024-09-21T07:07:57.671064+0000","last_fullsized":"2024-09-21T07:07:57.671064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:51.550091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664496+0000","last_change":"2024-09-21T07:07:32.570761+0000","last_active":"2024-09-21T07:07:57.664496+0000","last_peered":"2024-09-21T07:07:57.664496+0000","last_clean":"2024-09-21T07:07:57.664496+0000","last_became_active":"2024-09-21T07:07:32.569555+0000","last_became_peered":"2024-09-21T07:07:32.569555+0000","last_unstale":"2024-09-21T07:07:57.664496+0000","last_undegraded":"2024-09-21T07:07:57.664496+0000","last_fullsized":"2024-09-21T07:07:57.664496+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:23.414096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.702052+0000","last_change":"2024-09-21T07:07:57.701944+0000","last_active":"2024-09-21T07:07:57.702052+0000","last_peered":"2024-09-21T07:07:57.702052+0000","last_clean":"2024-09-21T07:07:57.702052+0000","last_became_active":"2024-09-21T07:07:57.701461+0000","last_became_peered":"2024-09-21T07:07:57.701461+0000","last_unstale":"2024-09-21T07:07:57.702052+0000","last_undegraded":"2024-09-21T07:07:57.702052+0000","last_fullsized":"2024-09-21T07:07:57.702052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:36.219766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700760+0000","last_change":"2024-09-21T07:07:32.550889+0000","last_active":"2024-09-21T07:07:57.700760+0000","last_peered":"2024-09-21T07:07:57.700760+0000","last_clean":"2024-09-21T07:07:57.700760+0000","last_became_active":"2024-09-21T07:07:32.550559+0000","last_became_peered":"2024-09-21T07:07:32.550559+0000","last_unstale":"2024-09-21T07:07:57.700760+0000","last_undegraded":"2024-09-21T07:07:57.700760+0000","last_fullsized":"2024-09-21T07:07:57.700760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:35.575626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669528+0000","last_change":"2024-09-21T07:07:32.552019+0000","last_active":"2024-09-21T07:07:57.669528+0000","last_peered":"2024-09-21T07:07:57.669528+0000","last_clean":"2024-09-21T07:07:57.669528+0000","last_became_active":"2024-09-21T07:07:32.551562+0000","last_became_peered":"2024-09-21T07:07:32.551562+0000","last_unstale":"2024-09-21T07:07:57.669528+0000","last_undegraded":"2024-09-21T07:07:57.669528+0000","last_fullsized":"2024-09-21T07:07:57.669528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:25.932560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669832+0000","last_change":"2024-09-21T07:07:32.556938+0000","last_active":"2024-09-21T07:07:57.669832+0000","last_peered":"2024-09-21T07:07:57.669832+0000","last_clean":"2024-09-21T07:07:57.669832+0000","last_became_active":"2024-09-21T07:07:32.556331+0000","last_became_peered":"2024-09-21T07:07:32.556331+0000","last_unstale":"2024-09-21T07:07:57.669832+0000","last_undegraded":"2024-09-21T07:07:57.669832+0000","last_fullsized":"2024-09-21T07:07:57.669832+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:43.358076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664137+0000","last_change":"2024-09-21T07:07:32.561984+0000","last_active":"2024-09-21T07:07:57.664137+0000","last_peered":"2024-09-21T07:07:57.664137+0000","last_clean":"2024-09-21T07:07:57.664137+0000","last_became_active":"2024-09-21T07:07:32.561227+0000","last_became_peered":"2024-09-21T07:07:32.561227+0000","last_unstale":"2024-09-21T07:07:57.664137+0000","last_undegraded":"2024-09-21T07:07:57.664137+0000","last_fullsized":"2024-09-21T07:07:57.664137+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:17:35.024196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666875+0000","last_change":"2024-09-21T07:07:32.567454+0000","last_active":"2024-09-21T07:07:57.666875+0000","last_peered":"2024-09-21T07:07:57.666875+0000","last_clean":"2024-09-21T07:07:57.666875+0000","last_became_active":"2024-09-21T07:07:32.567063+0000","last_became_peered":"2024-09-21T07:07:32.567063+0000","last_unstale":"2024-09-21T07:07:57.666875+0000","last_undegraded":"2024-09-21T07:07:57.666875+0000","last_fullsized":"2024-09-21T07:07:57.666875+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:38.466771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:48.732425+0000","last_change":"2024-09-21T07:07:30.548785+0000","last_active":"2024-09-21T07:08:48.732425+0000","last_peered":"2024-09-21T07:08:48.732425+0000","last_clean":"2024-09-21T07:08:48.732425+0000","last_became_active":"2024-09-21T07:07:30.547764+0000","last_became_peered":"2024-09-21T07:07:30.547764+0000","last_unstale":"2024-09-21T07:08:48.732425+0000","last_undegraded":"2024-09-21T07:08:48.732425+0000","last_fullsized":"2024-09-21T07:08:48.732425+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:18.115002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669774+0000","last_change":"2024-09-21T07:07:57.669607+0000","last_active":"2024-09-21T07:07:57.669774+0000","last_peered":"2024-09-21T07:07:57.669774+0000","last_clean":"2024-09-21T07:07:57.669774+0000","last_became_active":"2024-09-21T07:07:57.669149+0000","last_became_peered":"2024-09-21T07:07:57.669149+0000","last_unstale":"2024-09-21T07:07:57.669774+0000","last_undegraded":"2024-09-21T07:07:57.669774+0000","last_fullsized":"2024-09-21T07:07:57.669774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:20.180287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.686559+0000","last_change":"2024-09-21T07:07:57.686466+0000","last_active":"2024-09-21T07:07:57.686559+0000","last_peered":"2024-09-21T07:07:57.686559+0000","last_clean":"2024-09-21T07:07:57.686559+0000","last_became_active":"2024-09-21T07:07:57.671977+0000","last_became_peered":"2024-09-21T07:07:57.671977+0000","last_unstale":"2024-09-21T07:07:57.686559+0000","last_undegraded":"2024-09-21T07:07:57.686559+0000","last_fullsized":"2024-09-21T07:07:57.686559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:26.134854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663868+0000","last_change":"2024-09-21T07:07:30.539941+0000","last_active":"2024-09-21T07:07:57.663868+0000","last_peered":"2024-09-21T07:07:57.663868+0000","last_clean":"2024-09-21T07:07:57.663868+0000","last_became_active":"2024-09-21T07:07:30.539401+0000","last_became_peered":"2024-09-21T07:07:30.539401+0000","last_unstale":"2024-09-21T07:07:57.663868+0000","last_undegraded":"2024-09-21T07:07:57.663868+0000","last_fullsized":"2024-09-21T07:07:57.663868+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:15.184453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667870+0000","last_change":"2024-09-21T07:07:32.556958+0000","last_active":"2024-09-21T07:07:57.667870+0000","last_peered":"2024-09-21T07:07:57.667870+0000","last_clean":"2024-09-21T07:07:57.667870+0000","last_became_active":"2024-09-21T07:07:32.556581+0000","last_became_peered":"2024-09-21T07:07:32.556581+0000","last_unstale":"2024-09-21T07:07:57.667870+0000","last_undegraded":"2024-09-21T07:07:57.667870+0000","last_fullsized":"2024-09-21T07:07:57.667870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:57.618263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668760+0000","last_change":"2024-09-21T07:07:30.547760+0000","last_active":"2024-09-21T07:07:57.668760+0000","last_peered":"2024-09-21T07:07:57.668760+0000","last_clean":"2024-09-21T07:07:57.668760+0000","last_became_active":"2024-09-21T07:07:30.547327+0000","last_became_peered":"2024-09-21T07:07:30.547327+0000","last_unstale":"2024-09-21T07:07:57.668760+0000","last_undegraded":"2024-09-21T07:07:57.668760+0000","last_fullsized":"2024-09-21T07:07:57.668760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:01.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.660833+0000","last_change":"2024-09-21T07:07:32.552691+0000","last_active":"2024-09-21T07:07:57.660833+0000","last_peered":"2024-09-21T07:07:57.660833+0000","last_clean":"2024-09-21T07:07:57.660833+0000","last_became_active":"2024-09-21T07:07:32.552321+0000","last_became_peered":"2024-09-21T07:07:32.552321+0000","last_unstale":"2024-09-21T07:07:57.660833+0000","last_undegraded":"2024-09-21T07:07:57.660833+0000","last_fullsized":"2024-09-21T07:07:57.660833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:56.029399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":157,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:48.731772+0000","last_change":"2024-09-21T07:07:30.545281+0000","last_active":"2024-09-21T07:08:48.731772+0000","last_peered":"2024-09-21T07:08:48.731772+0000","last_clean":"2024-09-21T07:08:48.731772+0000","last_became_active":"2024-09-21T07:07:30.544823+0000","last_became_peered":"2024-09-21T07:07:30.544823+0000","last_unstale":"2024-09-21T07:08:48.731772+0000","last_undegraded":"2024-09-21T07:08:48.731772+0000","last_fullsized":"2024-09-21T07:08:48.731772+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.659421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670838+0000","last_change":"2024-09-21T07:07:32.567833+0000","last_active":"2024-09-21T07:07:57.670838+0000","last_peered":"2024-09-21T07:07:57.670838+0000","last_clean":"2024-09-21T07:07:57.670838+0000","last_became_active":"2024-09-21T07:07:32.566902+0000","last_became_peered":"2024-09-21T07:07:32.566902+0000","last_unstale":"2024-09-21T07:07:57.670838+0000","last_undegraded":"2024-09-21T07:07:57.670838+0000","last_fullsized":"2024-09-21T07:07:57.670838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:44.871038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.681468+0000","last_change":"2024-09-21T07:07:57.681319+0000","last_active":"2024-09-21T07:07:57.681468+0000","last_peered":"2024-09-21T07:07:57.681468+0000","last_clean":"2024-09-21T07:07:57.681468+0000","last_became_active":"2024-09-21T07:07:57.671744+0000","last_became_peered":"2024-09-21T07:07:57.671744+0000","last_unstale":"2024-09-21T07:07:57.681468+0000","last_undegraded":"2024-09-21T07:07:57.681468+0000","last_fullsized":"2024-09-21T07:07:57.681468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:41:51.145118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701091+0000","last_change":"2024-09-21T07:07:32.561445+0000","last_active":"2024-09-21T07:07:57.701091+0000","last_peered":"2024-09-21T07:07:57.701091+0000","last_clean":"2024-09-21T07:07:57.701091+0000","last_became_active":"2024-09-21T07:07:32.561033+0000","last_became_peered":"2024-09-21T07:07:32.561033+0000","last_unstale":"2024-09-21T07:07:57.701091+0000","last_undegraded":"2024-09-21T07:07:57.701091+0000","last_fullsized":"2024-09-21T07:07:57.701091+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:30.261234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668524+0000","last_change":"2024-09-21T07:07:30.755110+0000","last_active":"2024-09-21T07:07:57.668524+0000","last_peered":"2024-09-21T07:07:57.668524+0000","last_clean":"2024-09-21T07:07:57.668524+0000","last_became_active":"2024-09-21T07:07:30.754680+0000","last_became_peered":"2024-09-21T07:07:30.754680+0000","last_unstale":"2024-09-21T07:07:57.668524+0000","last_undegraded":"2024-09-21T07:07:57.668524+0000","last_fullsized":"2024-09-21T07:07:57.668524+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:28.202010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670386+0000","last_change":"2024-09-21T07:07:32.557349+0000","last_active":"2024-09-21T07:07:57.670386+0000","last_peered":"2024-09-21T07:07:57.670386+0000","last_clean":"2024-09-21T07:07:57.670386+0000","last_became_active":"2024-09-21T07:07:32.554342+0000","last_became_peered":"2024-09-21T07:07:32.554342+0000","last_unstale":"2024-09-21T07:07:57.670386+0000","last_undegraded":"2024-09-21T07:07:57.670386+0000","last_fullsized":"2024-09-21T07:07:57.670386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:21.356410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'30","reported_seq":192,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:48.731757+0000","last_change":"2024-09-21T07:07:30.547691+0000","last_active":"2024-09-21T07:08:48.731757+0000","last_peered":"2024-09-21T07:08:48.731757+0000","last_clean":"2024-09-21T07:08:48.731757+0000","last_became_active":"2024-09-21T07:07:30.547280+0000","last_became_peered":"2024-09-21T07:07:30.547280+0000","last_unstale":"2024-09-21T07:08:48.731757+0000","last_undegraded":"2024-09-21T07:08:48.731757+0000","last_fullsized":"2024-09-21T07:08:48.731757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:24.704573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64757,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":32,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665578+0000","last_change":"2024-09-21T07:07:32.569291+0000","last_active":"2024-09-21T07:07:57.665578+0000","last_peered":"2024-09-21T07:07:57.665578+0000","last_clean":"2024-09-21T07:07:57.665578+0000","last_became_active":"2024-09-21T07:07:32.568503+0000","last_became_peered":"2024-09-21T07:07:32.568503+0000","last_unstale":"2024-09-21T07:07:57.665578+0000","last_undegraded":"2024-09-21T07:07:57.665578+0000","last_fullsized":"2024-09-21T07:07:57.665578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:56.184795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.669620+0000","last_change":"2024-09-21T07:07:30.546624+0000","last_active":"2024-09-21T07:07:57.669620+0000","last_peered":"2024-09-21T07:07:57.669620+0000","last_clean":"2024-09-21T07:07:57.669620+0000","last_became_active":"2024-09-21T07:07:30.545497+0000","last_became_peered":"2024-09-21T07:07:30.545497+0000","last_unstale":"2024-09-21T07:07:57.669620+0000","last_undegraded":"2024-09-21T07:07:57.669620+0000","last_fullsized":"2024-09-21T07:07:57.669620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:58.963089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663965+0000","last_change":"2024-09-21T07:07:32.551123+0000","last_active":"2024-09-21T07:07:57.663965+0000","last_peered":"2024-09-21T07:07:57.663965+0000","last_clean":"2024-09-21T07:07:57.663965+0000","last_became_active":"2024-09-21T07:07:32.550423+0000","last_became_peered":"2024-09-21T07:07:32.550423+0000","last_unstale":"2024-09-21T07:07:57.663965+0000","last_undegraded":"2024-09-21T07:07:57.663965+0000","last_fullsized":"2024-09-21T07:07:57.663965+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:00.617108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668428+0000","last_change":"2024-09-21T07:07:30.550102+0000","last_active":"2024-09-21T07:07:57.668428+0000","last_peered":"2024-09-21T07:07:57.668428+0000","last_clean":"2024-09-21T07:07:57.668428+0000","last_became_active":"2024-09-21T07:07:30.549609+0000","last_became_peered":"2024-09-21T07:07:30.549609+0000","last_unstale":"2024-09-21T07:07:57.668428+0000","last_undegraded":"2024-09-21T07:07:57.668428+0000","last_fullsized":"2024-09-21T07:07:57.668428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:58.587612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666452+0000","last_change":"2024-09-21T07:07:32.556167+0000","last_active":"2024-09-21T07:07:57.666452+0000","last_peered":"2024-09-21T07:07:57.666452+0000","last_clean":"2024-09-21T07:07:57.666452+0000","last_became_active":"2024-09-21T07:07:32.555372+0000","last_became_peered":"2024-09-21T07:07:32.555372+0000","last_unstale":"2024-09-21T07:07:57.666452+0000","last_undegraded":"2024-09-21T07:07:57.666452+0000","last_fullsized":"2024-09-21T07:07:57.666452+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:35.056919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'6","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:48.732657+0000","last_change":"2024-09-21T07:07:30.543196+0000","last_active":"2024-09-21T07:08:48.732657+0000","last_peered":"2024-09-21T07:08:48.732657+0000","last_clean":"2024-09-21T07:08:48.732657+0000","last_became_active":"2024-09-21T07:07:30.542755+0000","last_became_peered":"2024-09-21T07:07:30.542755+0000","last_unstale":"2024-09-21T07:08:48.732657+0000","last_undegraded":"2024-09-21T07:08:48.732657+0000","last_fullsized":"2024-09-21T07:08:48.732657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:14.821703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665906+0000","last_change":"2024-09-21T07:07:32.561243+0000","last_active":"2024-09-21T07:07:57.665906+0000","last_peered":"2024-09-21T07:07:57.665906+0000","last_clean":"2024-09-21T07:07:57.665906+0000","last_became_active":"2024-09-21T07:07:32.560878+0000","last_became_peered":"2024-09-21T07:07:32.560878+0000","last_unstale":"2024-09-21T07:07:57.665906+0000","last_undegraded":"2024-09-21T07:07:57.665906+0000","last_fullsized":"2024-09-21T07:07:57.665906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:19.342422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664720+0000","last_change":"2024-09-21T07:07:30.754985+0000","last_active":"2024-09-21T07:07:57.664720+0000","last_peered":"2024-09-21T07:07:57.664720+0000","last_clean":"2024-09-21T07:07:57.664720+0000","last_became_active":"2024-09-21T07:07:30.754490+0000","last_became_peered":"2024-09-21T07:07:30.754490+0000","last_unstale":"2024-09-21T07:07:57.664720+0000","last_undegraded":"2024-09-21T07:07:57.664720+0000","last_fullsized":"2024-09-21T07:07:57.664720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:21.645643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.667978+0000","last_change":"2024-09-21T07:07:32.567997+0000","last_active":"2024-09-21T07:07:57.667978+0000","last_peered":"2024-09-21T07:07:57.667978+0000","last_clean":"2024-09-21T07:07:57.667978+0000","last_became_active":"2024-09-21T07:07:32.567314+0000","last_became_peered":"2024-09-21T07:07:32.567314+0000","last_unstale":"2024-09-21T07:07:57.667978+0000","last_undegraded":"2024-09-21T07:07:57.667978+0000","last_fullsized":"2024-09-21T07:07:57.667978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:43:07.741967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.678889+0000","last_change":"2024-09-21T07:07:57.678175+0000","last_active":"2024-09-21T07:07:57.678889+0000","last_peered":"2024-09-21T07:07:57.678889+0000","last_clean":"2024-09-21T07:07:57.678889+0000","last_became_active":"2024-09-21T07:07:57.671137+0000","last_became_peered":"2024-09-21T07:07:57.671137+0000","last_unstale":"2024-09-21T07:07:57.678889+0000","last_undegraded":"2024-09-21T07:07:57.678889+0000","last_fullsized":"2024-09-21T07:07:57.678889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:34:56.443614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664423+0000","last_change":"2024-09-21T07:07:32.563380+0000","last_active":"2024-09-21T07:07:57.664423+0000","last_peered":"2024-09-21T07:07:57.664423+0000","last_clean":"2024-09-21T07:07:57.664423+0000","last_became_active":"2024-09-21T07:07:32.563012+0000","last_became_peered":"2024-09-21T07:07:32.563012+0000","last_unstale":"2024-09-21T07:07:57.664423+0000","last_undegraded":"2024-09-21T07:07:57.664423+0000","last_fullsized":"2024-09-21T07:07:57.664423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:12.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664634+0000","last_change":"2024-09-21T07:07:30.546448+0000","last_active":"2024-09-21T07:07:57.664634+0000","last_peered":"2024-09-21T07:07:57.664634+0000","last_clean":"2024-09-21T07:07:57.664634+0000","last_became_active":"2024-09-21T07:07:30.546015+0000","last_became_peered":"2024-09-21T07:07:30.546015+0000","last_unstale":"2024-09-21T07:07:57.664634+0000","last_undegraded":"2024-09-21T07:07:57.664634+0000","last_fullsized":"2024-09-21T07:07:57.664634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:23.041651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666630+0000","last_change":"2024-09-21T07:07:32.562533+0000","last_active":"2024-09-21T07:07:57.666630+0000","last_peered":"2024-09-21T07:07:57.666630+0000","last_clean":"2024-09-21T07:07:57.666630+0000","last_became_active":"2024-09-21T07:07:32.562101+0000","last_became_peered":"2024-09-21T07:07:32.562101+0000","last_unstale":"2024-09-21T07:07:57.666630+0000","last_undegraded":"2024-09-21T07:07:57.666630+0000","last_fullsized":"2024-09-21T07:07:57.666630+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:49.853479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668720+0000","last_change":"2024-09-21T07:07:30.547263+0000","last_active":"2024-09-21T07:07:57.668720+0000","last_peered":"2024-09-21T07:07:57.668720+0000","last_clean":"2024-09-21T07:07:57.668720+0000","last_became_active":"2024-09-21T07:07:30.546874+0000","last_became_peered":"2024-09-21T07:07:30.546874+0000","last_unstale":"2024-09-21T07:07:57.668720+0000","last_undegraded":"2024-09-21T07:07:57.668720+0000","last_fullsized":"2024-09-21T07:07:57.668720+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:14:18.545407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666337+0000","last_change":"2024-09-21T07:07:32.560288+0000","last_active":"2024-09-21T07:07:57.666337+0000","last_peered":"2024-09-21T07:07:57.666337+0000","last_clean":"2024-09-21T07:07:57.666337+0000","last_became_active":"2024-09-21T07:07:32.559938+0000","last_became_peered":"2024-09-21T07:07:32.559938+0000","last_unstale":"2024-09-21T07:07:57.666337+0000","last_undegraded":"2024-09-21T07:07:57.666337+0000","last_fullsized":"2024-09-21T07:07:57.666337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:11:55.531828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'6","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:46.740824+0000","last_change":"2024-09-21T07:07:30.754602+0000","last_active":"2024-09-21T07:08:46.740824+0000","last_peered":"2024-09-21T07:08:46.740824+0000","last_clean":"2024-09-21T07:08:46.740824+0000","last_became_active":"2024-09-21T07:07:30.754159+0000","last_became_peered":"2024-09-21T07:07:30.754159+0000","last_unstale":"2024-09-21T07:08:46.740824+0000","last_undegraded":"2024-09-21T07:08:46.740824+0000","last_fullsized":"2024-09-21T07:08:46.740824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:29.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666629+0000","last_change":"2024-09-21T07:07:32.557819+0000","last_active":"2024-09-21T07:07:57.666629+0000","last_peered":"2024-09-21T07:07:57.666629+0000","last_clean":"2024-09-21T07:07:57.666629+0000","last_became_active":"2024-09-21T07:07:32.557363+0000","last_became_peered":"2024-09-21T07:07:32.557363+0000","last_unstale":"2024-09-21T07:07:57.666629+0000","last_undegraded":"2024-09-21T07:07:57.666629+0000","last_fullsized":"2024-09-21T07:07:57.666629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:14.802658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666087+0000","last_change":"2024-09-21T07:06:20.138629+0000","last_active":"2024-09-21T07:07:57.666087+0000","last_peered":"2024-09-21T07:07:57.666087+0000","last_clean":"2024-09-21T07:07:57.666087+0000","last_became_active":"2024-09-21T07:06:20.132041+0000","last_became_peered":"2024-09-21T07:06:20.132041+0000","last_unstale":"2024-09-21T07:07:57.666087+0000","last_undegraded":"2024-09-21T07:07:57.666087+0000","last_fullsized":"2024-09-21T07:07:57.666087+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:02:52.790893+0000","last_clean_scrub_stamp":"2024-09-21T07:02:52.790893+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:41.784916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668277+0000","last_change":"2024-09-21T07:07:30.541638+0000","last_active":"2024-09-21T07:07:57.668277+0000","last_peered":"2024-09-21T07:07:57.668277+0000","last_clean":"2024-09-21T07:07:57.668277+0000","last_became_active":"2024-09-21T07:07:30.541185+0000","last_became_peered":"2024-09-21T07:07:30.541185+0000","last_unstale":"2024-09-21T07:07:57.668277+0000","last_undegraded":"2024-09-21T07:07:57.668277+0000","last_fullsized":"2024-09-21T07:07:57.668277+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:15.837077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668365+0000","last_change":"2024-09-21T07:07:32.560817+0000","last_active":"2024-09-21T07:07:57.668365+0000","last_peered":"2024-09-21T07:07:57.668365+0000","last_clean":"2024-09-21T07:07:57.668365+0000","last_became_active":"2024-09-21T07:07:32.560269+0000","last_became_peered":"2024-09-21T07:07:32.560269+0000","last_unstale":"2024-09-21T07:07:57.668365+0000","last_undegraded":"2024-09-21T07:07:57.668365+0000","last_fullsized":"2024-09-21T07:07:57.668365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:40.109644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666042+0000","last_change":"2024-09-21T07:07:30.543936+0000","last_active":"2024-09-21T07:07:57.666042+0000","last_peered":"2024-09-21T07:07:57.666042+0000","last_clean":"2024-09-21T07:07:57.666042+0000","last_became_active":"2024-09-21T07:07:30.543530+0000","last_became_peered":"2024-09-21T07:07:30.543530+0000","last_unstale":"2024-09-21T07:07:57.666042+0000","last_undegraded":"2024-09-21T07:07:57.666042+0000","last_fullsized":"2024-09-21T07:07:57.666042+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:02.312471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.663848+0000","last_change":"2024-09-21T07:07:32.542182+0000","last_active":"2024-09-21T07:07:57.663848+0000","last_peered":"2024-09-21T07:07:57.663848+0000","last_clean":"2024-09-21T07:07:57.663848+0000","last_became_active":"2024-09-21T07:07:32.541750+0000","last_became_peered":"2024-09-21T07:07:32.541750+0000","last_unstale":"2024-09-21T07:07:57.663848+0000","last_undegraded":"2024-09-21T07:07:57.663848+0000","last_fullsized":"2024-09-21T07:07:57.663848+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:27.184712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:49.733496+0000","last_change":"2024-09-21T07:07:30.754978+0000","last_active":"2024-09-21T07:08:49.733496+0000","last_peered":"2024-09-21T07:08:49.733496+0000","last_clean":"2024-09-21T07:08:49.733496+0000","last_became_active":"2024-09-21T07:07:30.754149+0000","last_became_peered":"2024-09-21T07:07:30.754149+0000","last_unstale":"2024-09-21T07:08:49.733496+0000","last_undegraded":"2024-09-21T07:08:49.733496+0000","last_fullsized":"2024-09-21T07:08:49.733496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:36.140237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668604+0000","last_change":"2024-09-21T07:07:32.570424+0000","last_active":"2024-09-21T07:07:57.668604+0000","last_peered":"2024-09-21T07:07:57.668604+0000","last_clean":"2024-09-21T07:07:57.668604+0000","last_became_active":"2024-09-21T07:07:32.570029+0000","last_became_peered":"2024-09-21T07:07:32.570029+0000","last_unstale":"2024-09-21T07:07:57.668604+0000","last_undegraded":"2024-09-21T07:07:57.668604+0000","last_fullsized":"2024-09-21T07:07:57.668604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:09.703819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'6","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:49.733114+0000","last_change":"2024-09-21T07:07:30.543963+0000","last_active":"2024-09-21T07:08:49.733114+0000","last_peered":"2024-09-21T07:08:49.733114+0000","last_clean":"2024-09-21T07:08:49.733114+0000","last_became_active":"2024-09-21T07:07:30.543586+0000","last_became_peered":"2024-09-21T07:07:30.543586+0000","last_unstale":"2024-09-21T07:08:49.733114+0000","last_undegraded":"2024-09-21T07:08:49.733114+0000","last_fullsized":"2024-09-21T07:08:49.733114+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:58:05.782005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662307+0000","last_change":"2024-09-21T07:07:32.556132+0000","last_active":"2024-09-21T07:07:57.662307+0000","last_peered":"2024-09-21T07:07:57.662307+0000","last_clean":"2024-09-21T07:07:57.662307+0000","last_became_active":"2024-09-21T07:07:32.555717+0000","last_became_peered":"2024-09-21T07:07:32.555717+0000","last_unstale":"2024-09-21T07:07:57.662307+0000","last_undegraded":"2024-09-21T07:07:57.662307+0000","last_fullsized":"2024-09-21T07:07:57.662307+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:02:14.809268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661088+0000","last_change":"2024-09-21T07:07:30.755143+0000","last_active":"2024-09-21T07:07:57.661088+0000","last_peered":"2024-09-21T07:07:57.661088+0000","last_clean":"2024-09-21T07:07:57.661088+0000","last_became_active":"2024-09-21T07:07:30.754591+0000","last_became_peered":"2024-09-21T07:07:30.754591+0000","last_unstale":"2024-09-21T07:07:57.661088+0000","last_undegraded":"2024-09-21T07:07:57.661088+0000","last_fullsized":"2024-09-21T07:07:57.661088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:13.235959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.662201+0000","last_change":"2024-09-21T07:07:32.552869+0000","last_active":"2024-09-21T07:07:57.662201+0000","last_peered":"2024-09-21T07:07:57.662201+0000","last_clean":"2024-09-21T07:07:57.662201+0000","last_became_active":"2024-09-21T07:07:32.552483+0000","last_became_peered":"2024-09-21T07:07:32.552483+0000","last_unstale":"2024-09-21T07:07:57.662201+0000","last_undegraded":"2024-09-21T07:07:57.662201+0000","last_fullsized":"2024-09-21T07:07:57.662201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:21.006847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665762+0000","last_change":"2024-09-21T07:07:30.755552+0000","last_active":"2024-09-21T07:07:57.665762+0000","last_peered":"2024-09-21T07:07:57.665762+0000","last_clean":"2024-09-21T07:07:57.665762+0000","last_became_active":"2024-09-21T07:07:30.754451+0000","last_became_peered":"2024-09-21T07:07:30.754451+0000","last_unstale":"2024-09-21T07:07:57.665762+0000","last_undegraded":"2024-09-21T07:07:57.665762+0000","last_fullsized":"2024-09-21T07:07:57.665762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:42:50.229649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664284+0000","last_change":"2024-09-21T07:07:32.543249+0000","last_active":"2024-09-21T07:07:57.664284+0000","last_peered":"2024-09-21T07:07:57.664284+0000","last_clean":"2024-09-21T07:07:57.664284+0000","last_became_active":"2024-09-21T07:07:32.542866+0000","last_became_peered":"2024-09-21T07:07:32.542866+0000","last_unstale":"2024-09-21T07:07:57.664284+0000","last_undegraded":"2024-09-21T07:07:57.664284+0000","last_fullsized":"2024-09-21T07:07:57.664284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:29.476454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.661340+0000","last_change":"2024-09-21T07:07:30.541589+0000","last_active":"2024-09-21T07:07:57.661340+0000","last_peered":"2024-09-21T07:07:57.661340+0000","last_clean":"2024-09-21T07:07:57.661340+0000","last_became_active":"2024-09-21T07:07:30.541171+0000","last_became_peered":"2024-09-21T07:07:30.541171+0000","last_unstale":"2024-09-21T07:07:57.661340+0000","last_undegraded":"2024-09-21T07:07:57.661340+0000","last_fullsized":"2024-09-21T07:07:57.661340+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:46.318558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668335+0000","last_change":"2024-09-21T07:07:32.558409+0000","last_active":"2024-09-21T07:07:57.668335+0000","last_peered":"2024-09-21T07:07:57.668335+0000","last_clean":"2024-09-21T07:07:57.668335+0000","last_became_active":"2024-09-21T07:07:32.557886+0000","last_became_peered":"2024-09-21T07:07:32.557886+0000","last_unstale":"2024-09-21T07:07:57.668335+0000","last_undegraded":"2024-09-21T07:07:57.668335+0000","last_fullsized":"2024-09-21T07:07:57.668335+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:38.071651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668890+0000","last_change":"2024-09-21T07:07:30.536107+0000","last_active":"2024-09-21T07:07:57.668890+0000","last_peered":"2024-09-21T07:07:57.668890+0000","last_clean":"2024-09-21T07:07:57.668890+0000","last_became_active":"2024-09-21T07:07:30.535455+0000","last_became_peered":"2024-09-21T07:07:30.535455+0000","last_unstale":"2024-09-21T07:07:57.668890+0000","last_undegraded":"2024-09-21T07:07:57.668890+0000","last_fullsized":"2024-09-21T07:07:57.668890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:55.739895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.700974+0000","last_change":"2024-09-21T07:07:32.553187+0000","last_active":"2024-09-21T07:07:57.700974+0000","last_peered":"2024-09-21T07:07:57.700974+0000","last_clean":"2024-09-21T07:07:57.700974+0000","last_became_active":"2024-09-21T07:07:32.552905+0000","last_became_peered":"2024-09-21T07:07:32.552905+0000","last_unstale":"2024-09-21T07:07:57.700974+0000","last_undegraded":"2024-09-21T07:07:57.700974+0000","last_fullsized":"2024-09-21T07:07:57.700974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:24.790329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670080+0000","last_change":"2024-09-21T07:07:30.754858+0000","last_active":"2024-09-21T07:07:57.670080+0000","last_peered":"2024-09-21T07:07:57.670080+0000","last_clean":"2024-09-21T07:07:57.670080+0000","last_became_active":"2024-09-21T07:07:30.754483+0000","last_became_peered":"2024-09-21T07:07:30.754483+0000","last_unstale":"2024-09-21T07:07:57.670080+0000","last_undegraded":"2024-09-21T07:07:57.670080+0000","last_fullsized":"2024-09-21T07:07:57.670080+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:29.912001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664984+0000","last_change":"2024-09-21T07:07:32.562213+0000","last_active":"2024-09-21T07:07:57.664984+0000","last_peered":"2024-09-21T07:07:57.664984+0000","last_clean":"2024-09-21T07:07:57.664984+0000","last_became_active":"2024-09-21T07:07:32.561834+0000","last_became_peered":"2024-09-21T07:07:32.561834+0000","last_unstale":"2024-09-21T07:07:57.664984+0000","last_undegraded":"2024-09-21T07:07:57.664984+0000","last_fullsized":"2024-09-21T07:07:57.664984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:12.050977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668009+0000","last_change":"2024-09-21T07:07:30.543455+0000","last_active":"2024-09-21T07:07:57.668009+0000","last_peered":"2024-09-21T07:07:57.668009+0000","last_clean":"2024-09-21T07:07:57.668009+0000","last_became_active":"2024-09-21T07:07:30.543059+0000","last_became_peered":"2024-09-21T07:07:30.543059+0000","last_unstale":"2024-09-21T07:07:57.668009+0000","last_undegraded":"2024-09-21T07:07:57.668009+0000","last_fullsized":"2024-09-21T07:07:57.668009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:33.896121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.664245+0000","last_change":"2024-09-21T07:07:32.560600+0000","last_active":"2024-09-21T07:07:57.664245+0000","last_peered":"2024-09-21T07:07:57.664245+0000","last_clean":"2024-09-21T07:07:57.664245+0000","last_became_active":"2024-09-21T07:07:32.560159+0000","last_became_peered":"2024-09-21T07:07:32.560159+0000","last_unstale":"2024-09-21T07:07:57.664245+0000","last_undegraded":"2024-09-21T07:07:57.664245+0000","last_fullsized":"2024-09-21T07:07:57.664245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.228180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.683341+0000","last_change":"2024-09-21T07:07:57.682685+0000","last_active":"2024-09-21T07:07:57.683341+0000","last_peered":"2024-09-21T07:07:57.683341+0000","last_clean":"2024-09-21T07:07:57.683341+0000","last_became_active":"2024-09-21T07:07:57.671259+0000","last_became_peered":"2024-09-21T07:07:57.671259+0000","last_unstale":"2024-09-21T07:07:57.683341+0000","last_undegraded":"2024-09-21T07:07:57.683341+0000","last_fullsized":"2024-09-21T07:07:57.683341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:01.793138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668076+0000","last_change":"2024-09-21T07:07:32.554033+0000","last_active":"2024-09-21T07:07:57.668076+0000","last_peered":"2024-09-21T07:07:57.668076+0000","last_clean":"2024-09-21T07:07:57.668076+0000","last_became_active":"2024-09-21T07:07:32.553654+0000","last_became_peered":"2024-09-21T07:07:32.553654+0000","last_unstale":"2024-09-21T07:07:57.668076+0000","last_undegraded":"2024-09-21T07:07:57.668076+0000","last_fullsized":"2024-09-21T07:07:57.668076+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:15.876104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665390+0000","last_change":"2024-09-21T07:07:30.547818+0000","last_active":"2024-09-21T07:07:57.665390+0000","last_peered":"2024-09-21T07:07:57.665390+0000","last_clean":"2024-09-21T07:07:57.665390+0000","last_became_active":"2024-09-21T07:07:30.547387+0000","last_became_peered":"2024-09-21T07:07:30.547387+0000","last_unstale":"2024-09-21T07:07:57.665390+0000","last_undegraded":"2024-09-21T07:07:57.665390+0000","last_fullsized":"2024-09-21T07:07:57.665390+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:03.977064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.666216+0000","last_change":"2024-09-21T07:07:32.566731+0000","last_active":"2024-09-21T07:07:57.666216+0000","last_peered":"2024-09-21T07:07:57.666216+0000","last_clean":"2024-09-21T07:07:57.666216+0000","last_became_active":"2024-09-21T07:07:32.566233+0000","last_became_peered":"2024-09-21T07:07:32.566233+0000","last_unstale":"2024-09-21T07:07:57.666216+0000","last_undegraded":"2024-09-21T07:07:57.666216+0000","last_fullsized":"2024-09-21T07:07:57.666216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:57.630088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.673727+0000","last_change":"2024-09-21T07:07:57.673550+0000","last_active":"2024-09-21T07:07:57.673727+0000","last_peered":"2024-09-21T07:07:57.673727+0000","last_clean":"2024-09-21T07:07:57.673727+0000","last_became_active":"2024-09-21T07:07:57.673036+0000","last_became_peered":"2024-09-21T07:07:57.673036+0000","last_unstale":"2024-09-21T07:07:57.673727+0000","last_undegraded":"2024-09-21T07:07:57.673727+0000","last_fullsized":"2024-09-21T07:07:57.673727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:53.500746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665716+0000","last_change":"2024-09-21T07:07:30.544884+0000","last_active":"2024-09-21T07:07:57.665716+0000","last_peered":"2024-09-21T07:07:57.665716+0000","last_clean":"2024-09-21T07:07:57.665716+0000","last_became_active":"2024-09-21T07:07:30.543321+0000","last_became_peered":"2024-09-21T07:07:30.543321+0000","last_unstale":"2024-09-21T07:07:57.665716+0000","last_undegraded":"2024-09-21T07:07:57.665716+0000","last_fullsized":"2024-09-21T07:07:57.665716+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.234905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.670015+0000","last_change":"2024-09-21T07:07:32.566124+0000","last_active":"2024-09-21T07:07:57.670015+0000","last_peered":"2024-09-21T07:07:57.670015+0000","last_clean":"2024-09-21T07:07:57.670015+0000","last_became_active":"2024-09-21T07:07:32.565743+0000","last_became_peered":"2024-09-21T07:07:32.565743+0000","last_unstale":"2024-09-21T07:07:57.670015+0000","last_undegraded":"2024-09-21T07:07:57.670015+0000","last_fullsized":"2024-09-21T07:07:57.670015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:57.048529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.665685+0000","last_change":"2024-09-21T07:07:30.546742+0000","last_active":"2024-09-21T07:07:57.665685+0000","last_peered":"2024-09-21T07:07:57.665685+0000","last_clean":"2024-09-21T07:07:57.665685+0000","last_became_active":"2024-09-21T07:07:30.546300+0000","last_became_peered":"2024-09-21T07:07:30.546300+0000","last_unstale":"2024-09-21T07:07:57.665685+0000","last_undegraded":"2024-09-21T07:07:57.665685+0000","last_fullsized":"2024-09-21T07:07:57.665685+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:03:58.903582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.701061+0000","last_change":"2024-09-21T07:07:32.565602+0000","last_active":"2024-09-21T07:07:57.701061+0000","last_peered":"2024-09-21T07:07:57.701061+0000","last_clean":"2024-09-21T07:07:57.701061+0000","last_became_active":"2024-09-21T07:07:32.565252+0000","last_became_peered":"2024-09-21T07:07:32.565252+0000","last_unstale":"2024-09-21T07:07:57.701061+0000","last_undegraded":"2024-09-21T07:07:57.701061+0000","last_fullsized":"2024-09-21T07:07:57.701061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:50.969913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668572+0000","last_change":"2024-09-21T07:07:30.754535+0000","last_active":"2024-09-21T07:07:57.668572+0000","last_peered":"2024-09-21T07:07:57.668572+0000","last_clean":"2024-09-21T07:07:57.668572+0000","last_became_active":"2024-09-21T07:07:30.754129+0000","last_became_peered":"2024-09-21T07:07:30.754129+0000","last_unstale":"2024-09-21T07:07:57.668572+0000","last_undegraded":"2024-09-21T07:07:57.668572+0000","last_fullsized":"2024-09-21T07:07:57.668572+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:23.800713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:07:57.668229+0000","last_change":"2024-09-21T07:07:32.561210+0000","last_active":"2024-09-21T07:07:57.668229+0000","last_peered":"2024-09-21T07:07:57.668229+0000","last_clean":"2024-09-21T07:07:57.668229+0000","last_became_active":"2024-09-21T07:07:32.560850+0000","last_became_peered":"2024-09-21T07:07:32.560850+0000","last_unstale":"2024-09-21T07:07:57.668229+0000","last_undegraded":"2024-09-21T07:07:57.668229+0000","last_fullsized":"2024-09-21T07:07:57.668229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:31.529868+0000","last_clean_scrub_stamp":"2024-09-21T07:07:31.529868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:49:52.212097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":100,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T07:08:45.726040+0000","last_change":"2024-09-21T07:07:30.543778+0000","last_active":"2024-09-21T07:08:45.726040+0000","last_peered":"2024-09-21T07:08:45.726040+0000","last_clean":"2024-09-21T07:08:45.726040+0000","last_became_active":"2024-09-21T07:07:30.543474+0000","last_became_peered":"2024-09-21T07:07:30.543474+0000","last_unstale":"2024-09-21T07:08:45.726040+0000","last_undegraded":"2024-09-21T07:08:45.726040+0000","last_fullsized":"2024-09-21T07:08:45.726040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:07:29.520131+0000","last_clean_scrub_stamp":"2024-09-21T07:07:29.520131+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:06.638920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72352,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":694,"num_read_kb":423,"num_write":246,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":217056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808861,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":395386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972386,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40992,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704160,"statfs":{"total":95995035648,"available":95953059840,"internally_reserved":0,"allocated":1523712,"data_stored":1051150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135910,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":843776,"data_stored":394903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332140,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":395259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528370,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1437696,"data_stored":988190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36156,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708996,"statfs":{"total":95995035648,"available":95958011904,"internally_reserved":0,"allocated":827392,"data_stored":395011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888124,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1449984,"data_stored":987086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":827392,"data_stored":394872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215174,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":394445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":460901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":460681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40340,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704812,"statfs":{"total":95995035648,"available":95953727488,"internally_reserved":0,"allocated":847872,"data_stored":396350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:08:54.298 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T07:08:54.298 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:08:54.298 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:08:54.298 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T07:08:54.559 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:54.996 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:54 smithi029 ceph-mon[30983]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:08:55.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 -- 172.21.15.29:0/4223910776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 msgr2=0x7f8fe01023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/4223910776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01023f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009900 tx=0x7f8fd002a410 comp rx=0 tx=0).stop 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 -- 172.21.15.29:0/4223910776 shutdown_connections 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/4223910776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe0109e10 0x7f8fe0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/4223910776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe01094c0 0x7f8fe01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/4223910776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01023f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 -- 172.21.15.29:0/4223910776 >> 172.21.15.29:0/4223910776 conn(0x7f8fe0077bc0 msgr2=0x7f8fe0078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 -- 172.21.15.29:0/4223910776 shutdown_connections 2024-09-21T07:08:55.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.084+0000 7f8fe48ec640 1 -- 172.21.15.29:0/4223910776 wait complete. 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.085+0000 7f8fe48ec640 1 Processor -- start 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.085+0000 7f8fe48ec640 1 -- start start 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fe48ec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fe48ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe01094c0 0x7f8fe0102fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fe48ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe0109e10 0x7f8fe0103500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fe48ec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0113b60 con 0x7f8fe0101fe0 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fe48ec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe01139e0 con 0x7f8fe0109e10 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fe48ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0113ce0 con 0x7f8fe01094c0 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fde59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fde59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01049b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48686/0 (socket says 172.21.15.29:48686) 2024-09-21T07:08:55.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fde59c640 1 -- 172.21.15.29:0/3890821774 learned_addr learned my addr 172.21.15.29:0/3890821774 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fded9d640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe0109e10 0x7f8fe0103500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.086+0000 7f8fddd9b640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe01094c0 0x7f8fe0102fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fded9d640 1 -- 172.21.15.29:0/3890821774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe01094c0 msgr2=0x7f8fe0102fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fded9d640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe01094c0 0x7f8fe0102fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fded9d640 1 -- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 msgr2=0x7f8fe01049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fded9d640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fded9d640 1 -- 172.21.15.29:0/3890821774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe0103d20 con 0x7f8fe0109e10 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fde59c640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fded9d640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe0109e10 0x7f8fe0103500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800be20 tx=0x7f8fd8009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fcf7fe640 1 -- 172.21.15.29:0/3890821774 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8019070 con 0x7f8fe0109e10 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fcf7fe640 1 -- 172.21.15.29:0/3890821774 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd800cd70 con 0x7f8fe0109e10 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe01acf90 con 0x7f8fe0109e10 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fcf7fe640 1 -- 172.21.15.29:0/3890821774 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8012720 con 0x7f8fe0109e10 2024-09-21T07:08:55.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.087+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe01ad470 con 0x7f8fe0109e10 2024-09-21T07:08:55.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.088+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe0102470 con 0x7f8fe0109e10 2024-09-21T07:08:55.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.090+0000 7f8fcf7fe640 1 -- 172.21.15.29:0/3890821774 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8fd801c070 con 0x7f8fe0109e10 2024-09-21T07:08:55.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.090+0000 7f8fcf7fe640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fc80b65a0 0x7f8fc80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:55.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.091+0000 7f8fde59c640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fc80b65a0 0x7f8fc80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:55.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.091+0000 7f8fcf7fe640 1 -- 172.21.15.29:0/3890821774 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8fd80e6f90 con 0x7f8fe0109e10 2024-09-21T07:08:55.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.091+0000 7f8fde59c640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fc80b65a0 0x7f8fc80b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0031440 tx=0x7f8fd00058d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:55.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.094+0000 7f8fcf7fe640 1 -- 172.21.15.29:0/3890821774 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fd80b1a50 con 0x7f8fe0109e10 2024-09-21T07:08:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:54 smithi052 ceph-mon[34308]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:08:55.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.320+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8fe002e640 con 0x7f8fe0109e10 2024-09-21T07:08:55.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.321+0000 7f8fcf7fe640 1 -- 172.21.15.29:0/3890821774 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8fd80b6990 con 0x7f8fe0109e10 2024-09-21T07:08:55.323 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:55.323 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fc80b65a0 msgr2=0x7f8fc80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fc80b65a0 0x7f8fc80b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0031440 tx=0x7f8fd00058d0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe0109e10 msgr2=0x7f8fe0103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe0109e10 0x7f8fe0103500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800be20 tx=0x7f8fd8009ed0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 shutdown_connections 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8fc80b65a0 0x7f8fc80b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8fe0109e10 0x7f8fe0103500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fe01094c0 0x7f8fe0102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 --2- 172.21.15.29:0/3890821774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fe0101fe0 0x7f8fe01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 >> 172.21.15.29:0/3890821774 conn(0x7f8fe0077bc0 msgr2=0x7f8fe0107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 shutdown_connections 2024-09-21T07:08:55.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:55.324+0000 7f8fe48ec640 1 -- 172.21.15.29:0/3890821774 wait complete. 2024-09-21T07:08:55.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:54 smithi066 ceph-mon[34793]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:08:56.064 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:55 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3890821774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:08:56.099 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:08:56.100 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:08:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:55 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3890821774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:08:56.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:55 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3890821774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T07:08:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 -- 172.21.15.29:0/4046521670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248102100 msgr2=0x7fe248102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/4046521670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248102100 0x7fe248102510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe244009900 tx=0x7fe24402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 -- 172.21.15.29:0/4046521670 shutdown_connections 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/4046521670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe248106ca0 0x7fe248110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/4046521670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe248106350 0x7fe248106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/4046521670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248102100 0x7fe248102510 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 -- 172.21.15.29:0/4046521670 >> 172.21.15.29:0/4046521670 conn(0x7fe248079ec0 msgr2=0x7fe24807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 -- 172.21.15.29:0/4046521670 shutdown_connections 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 -- 172.21.15.29:0/4046521670 wait complete. 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 Processor -- start 2024-09-21T07:08:56.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.868+0000 7fe24f6ce640 1 -- start start 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24f6ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe248102100 0x7fe24819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24f6ce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248106350 0x7fe24819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24f6ce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe248106ca0 0x7fe24819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24f6ce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe248113b50 con 0x7fe248106350 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24f6ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe2481139d0 con 0x7fe248102100 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24f6ce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe248113cd0 con 0x7fe248106ca0 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248106350 0x7fe24819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248106350 0x7fe24819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:48712/0 (socket says 172.21.15.29:48712) 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 -- 172.21.15.29:0/2544105295 learned_addr learned my addr 172.21.15.29:0/2544105295 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24dc6b640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe248106ca0 0x7fe24819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24d46a640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe248102100 0x7fe24819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 -- 172.21.15.29:0/2544105295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe248106ca0 msgr2=0x7fe24819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:56.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe248106ca0 0x7fe24819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 -- 172.21.15.29:0/2544105295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe248102100 msgr2=0x7fe24819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe248102100 0x7fe24819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 -- 172.21.15.29:0/2544105295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2481a0530 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24d46a640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe248102100 0x7fe24819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe24cc69640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248106350 0x7fe24819ab60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe23800e9f0 tx=0x7fe23800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.869+0000 7fe23e7fc640 1 -- 172.21.15.29:0/2544105295 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23800ccc0 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.870+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2481a0820 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.870+0000 7fe23e7fc640 1 -- 172.21.15.29:0/2544105295 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2380108e0 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.870+0000 7fe23e7fc640 1 -- 172.21.15.29:0/2544105295 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238018860 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.870+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2481a6f80 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.871+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe248102510 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.872+0000 7fe23e7fc640 1 -- 172.21.15.29:0/2544105295 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fe238010430 con 0x7fe248106350 2024-09-21T07:08:56.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.873+0000 7fe23e7fc640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe2340b65a0 0x7fe2340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:56.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.873+0000 7fe24d46a640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe2340b65a0 0x7fe2340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:56.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.873+0000 7fe23e7fc640 1 -- 172.21.15.29:0/2544105295 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fe2380e7d40 con 0x7fe248106350 2024-09-21T07:08:56.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.873+0000 7fe24d46a640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe2340b65a0 0x7fe2340b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe244000c00 tx=0x7fe244032cb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:56.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:56.876+0000 7fe23e7fc640 1 -- 172.21.15.29:0/2544105295 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2380ae480 con 0x7fe248106350 2024-09-21T07:08:57.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.103+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe24810bd30 con 0x7fe248106350 2024-09-21T07:08:57.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:56 smithi029 ceph-mon[30983]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:08:57.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.103+0000 7fe23e7fc640 1 -- 172.21.15.29:0/2544105295 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11958 (secure 0 0 0) 0x7fe2380b2860 con 0x7fe248106350 2024-09-21T07:08:57.107 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:57.107 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"btime":"2024-09-21T07:07:44:626522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:07:44.626498+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:08:57.107 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2024-09-21T07:08:57.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe2340b65a0 msgr2=0x7fe2340b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe2340b65a0 0x7fe2340b8ab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe244000c00 tx=0x7fe244032cb0 comp rx=0 tx=0).stop 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248106350 msgr2=0x7fe24819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248106350 0x7fe24819ab60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe23800e9f0 tx=0x7fe23800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 shutdown_connections 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe2340b65a0 0x7fe2340b8ab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe248106ca0 0x7fe24819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe248106350 0x7fe24819ab60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 --2- 172.21.15.29:0/2544105295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe248102100 0x7fe24819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 >> 172.21.15.29:0/2544105295 conn(0x7fe248079ec0 msgr2=0x7fe2481075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 shutdown_connections 2024-09-21T07:08:57.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:57.106+0000 7fe24f6ce640 1 -- 172.21.15.29:0/2544105295 wait complete. 2024-09-21T07:08:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:56 smithi052 ceph-mon[34308]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:08:57.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:56 smithi066 ceph-mon[34793]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:08:57.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:08:58.049 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:08:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:57 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2544105295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:08:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:57 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2544105295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:08:58.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:57 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2544105295' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:08:58.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 -- 172.21.15.29:0/3640834545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108400 msgr2=0x7f26a8108810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 --2- 172.21.15.29:0/3640834545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108400 0x7f26a8108810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2694009900 tx=0x7f269402a410 comp rx=0 tx=0).stop 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 -- 172.21.15.29:0/3640834545 shutdown_connections 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 --2- 172.21.15.29:0/3640834545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a8108d50 0x7f26a810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 --2- 172.21.15.29:0/3640834545 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108400 0x7f26a8108810 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 --2- 172.21.15.29:0/3640834545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a8103190 0x7f26a81035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 -- 172.21.15.29:0/3640834545 >> 172.21.15.29:0/3640834545 conn(0x7f26a8079f90 msgr2=0x7f26a807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 -- 172.21.15.29:0/3640834545 shutdown_connections 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 -- 172.21.15.29:0/3640834545 wait complete. 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 Processor -- start 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.520+0000 7f26af0d6640 1 -- start start 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26af0d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a8103190 0x7f26a8199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26af0d6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a8108400 0x7f26a8199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26af0d6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108d50 0x7f26a819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26af0d6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8112a10 con 0x7f26a8108d50 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26af0d6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8112890 con 0x7f26a8103190 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26af0d6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26a8112b90 con 0x7f26a8108400 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108d50 0x7f26a819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108d50 0x7f26a819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53604/0 (socket says 172.21.15.29:53604) 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 -- 172.21.15.29:0/2409205348 learned_addr learned my addr 172.21.15.29:0/2409205348 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26a7fff640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a8108400 0x7f26a8199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ace72640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a8103190 0x7f26a8199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 -- 172.21.15.29:0/2409205348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a8108400 msgr2=0x7f26a8199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a8108400 0x7f26a8199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 -- 172.21.15.29:0/2409205348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a8103190 msgr2=0x7f26a8199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a8103190 0x7f26a8199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 -- 172.21.15.29:0/2409205348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a819f3b0 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ace72640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a8103190 0x7f26a8199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.521+0000 7f26ad673640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108d50 0x7f26a819ed40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26a000cad0 tx=0x7f26a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.522+0000 7f26a5ffb640 1 -- 172.21.15.29:0/2409205348 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a000ae20 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.522+0000 7f26a5ffb640 1 -- 172.21.15.29:0/2409205348 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26a0005020 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.522+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a819f6a0 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.522+0000 7f26a5ffb640 1 -- 172.21.15.29:0/2409205348 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a000f6b0 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.522+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a819fb60 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.523+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a81035a0 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.524+0000 7f26a5ffb640 1 -- 172.21.15.29:0/2409205348 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f26a00051d0 con 0x7f26a8108d50 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.525+0000 7f26a5ffb640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26980b65d0 0x7f26980b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:08:58.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.525+0000 7f26ace72640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26980b65d0 0x7f26980b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:08:58.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.525+0000 7f26a5ffb640 1 -- 172.21.15.29:0/2409205348 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f26a00e7800 con 0x7f26a8108d50 2024-09-21T07:08:58.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.526+0000 7f26ace72640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26980b65d0 0x7f26980b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f269c00abe0 tx=0x7f269c00a5c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:08:58.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.528+0000 7f26a5ffb640 1 -- 172.21.15.29:0/2409205348 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26a0014030 con 0x7f26a8108d50 2024-09-21T07:08:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.770+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26a819a630 con 0x7f26a8108d50 2024-09-21T07:08:58.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.771+0000 7f26a5ffb640 1 -- 172.21.15.29:0/2409205348 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11958 (secure 0 0 0) 0x7f26a00adf40 con 0x7f26a8108d50 2024-09-21T07:08:58.774 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:08:58.774 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"btime":"2024-09-21T07:07:44:626522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:07:44.626498+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:08:58.774 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26980b65d0 msgr2=0x7f26980b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26980b65d0 0x7f26980b8ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f269c00abe0 tx=0x7f269c00a5c0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108d50 msgr2=0x7f26a819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108d50 0x7f26a819ed40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f26a000cad0 tx=0x7f26a000cf90 comp rx=0 tx=0).stop 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 shutdown_connections 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f26980b65d0 0x7f26980b8ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a8108d50 0x7f26a819ed40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26a8108400 0x7f26a8199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 --2- 172.21.15.29:0/2409205348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26a8103190 0x7f26a8199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:08:58.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 >> 172.21.15.29:0/2409205348 conn(0x7f26a8079f90 msgr2=0x7f26a81065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:08:58.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 shutdown_connections 2024-09-21T07:08:58.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:08:58.773+0000 7f26af0d6640 1 -- 172.21.15.29:0/2409205348 wait complete. 2024-09-21T07:08:59.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:58 smithi029 ceph-mon[30983]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:08:59.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:58 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2409205348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:08:59.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:58 smithi052 ceph-mon[34308]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:08:59.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:58 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2409205348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:08:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:58 smithi066 ceph-mon[34793]: pgmap v336: 97 pgs: 97 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-21T07:08:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:58 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2409205348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:08:59.490 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:08:59.750 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:00.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:08:59 smithi029 ceph-mon[30983]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 -- 172.21.15.29:0/2050350519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8109df0 msgr2=0x7f1fc8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 --2- 172.21.15.29:0/2050350519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8109df0 0x7f1fc8110620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009ca0 tx=0x7f1fc002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 -- 172.21.15.29:0/2050350519 shutdown_connections 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 --2- 172.21.15.29:0/2050350519 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8109df0 0x7f1fc8110620 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 --2- 172.21.15.29:0/2050350519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fc81094a0 0x7f1fc81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 --2- 172.21.15.29:0/2050350519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc8103b60 0x7f1fc8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 -- 172.21.15.29:0/2050350519 >> 172.21.15.29:0/2050350519 conn(0x7f1fc807b850 msgr2=0x7f1fc807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 -- 172.21.15.29:0/2050350519 shutdown_connections 2024-09-21T07:09:00.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.236+0000 7f1fcedde640 1 -- 172.21.15.29:0/2050350519 wait complete. 2024-09-21T07:09:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 Processor -- start 2024-09-21T07:09:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 -- start start 2024-09-21T07:09:00.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8103b60 0x7f1fc8198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc81094a0 0x7f1fc81994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fc8109df0 0x7f1fc819ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc8113ab0 con 0x7f1fc8103b60 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc8113930 con 0x7f1fc8109df0 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fcedde640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc8113c30 con 0x7f1fc81094a0 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fccb7a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8103b60 0x7f1fc8198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fccb7a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8103b60 0x7f1fc8198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53626/0 (socket says 172.21.15.29:53626) 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fccb7a640 1 -- 172.21.15.29:0/4173149337 learned_addr learned my addr 172.21.15.29:0/4173149337 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.237+0000 7f1fc7fff640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc81094a0 0x7f1fc81994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fcd37b640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fc8109df0 0x7f1fc819ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fccb7a640 1 -- 172.21.15.29:0/4173149337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc81094a0 msgr2=0x7f1fc81994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fccb7a640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc81094a0 0x7f1fc81994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fccb7a640 1 -- 172.21.15.29:0/4173149337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fc8109df0 msgr2=0x7f1fc819ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fccb7a640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fc8109df0 0x7f1fc819ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fccb7a640 1 -- 172.21.15.29:0/4173149337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc8199d40 con 0x7f1fc8103b60 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fc7fff640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc81094a0 0x7f1fc81994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fccb7a640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8103b60 0x7f1fc8198f60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00d950 tx=0x7f1fbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fc5ffb640 1 -- 172.21.15.29:0/4173149337 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc017030 con 0x7f1fc8103b60 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fc5ffb640 1 -- 172.21.15.29:0/4173149337 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fbc004020 con 0x7f1fc8103b60 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc81a05c0 con 0x7f1fc8103b60 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.238+0000 7f1fc5ffb640 1 -- 172.21.15.29:0/4173149337 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0047a0 con 0x7f1fc8103b60 2024-09-21T07:09:00.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.239+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc81a0b00 con 0x7f1fc8103b60 2024-09-21T07:09:00.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:08:59 smithi052 ceph-mon[34308]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:09:00.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.240+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc8103f70 con 0x7f1fc8103b60 2024-09-21T07:09:00.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.241+0000 7f1fc5ffb640 1 -- 172.21.15.29:0/4173149337 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1fbc009a30 con 0x7f1fc8103b60 2024-09-21T07:09:00.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.242+0000 7f1fc5ffb640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fb80b6510 0x7f1fb80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:00.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.242+0000 7f1fc7fff640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fb80b6510 0x7f1fb80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:00.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.242+0000 7f1fc5ffb640 1 -- 172.21.15.29:0/4173149337 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1fbc0e7330 con 0x7f1fc8103b60 2024-09-21T07:09:00.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.243+0000 7f1fc7fff640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fb80b6510 0x7f1fb80b8a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8108f60 tx=0x7f1fb400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:00.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.245+0000 7f1fc5ffb640 1 -- 172.21.15.29:0/4173149337 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1fbc0adbd0 con 0x7f1fc8103b60 2024-09-21T07:09:00.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:08:59 smithi066 ceph-mon[34793]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-21T07:09:00.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.433+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fc81a0f80 con 0x7f1fc8103b60 2024-09-21T07:09:00.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.434+0000 7f1fc5ffb640 1 -- 172.21.15.29:0/4173149337 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22640 (secure 0 0 0) 0x7f1fbc0b1fb0 con 0x7f1fc8103b60 2024-09-21T07:09:00.437 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:00.437 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":75,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:57.657853+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:09:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.436+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fb80b6510 msgr2=0x7f1fb80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.436+0000 7f1fcedde640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fb80b6510 0x7f1fb80b8a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8108f60 tx=0x7f1fb400b390 comp rx=0 tx=0).stop 2024-09-21T07:09:00.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.436+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8103b60 msgr2=0x7f1fc8198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.436+0000 7f1fcedde640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8103b60 0x7f1fc8198f60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00d950 tx=0x7f1fbc00de10 comp rx=0 tx=0).stop 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 shutdown_connections 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1fb80b6510 0x7f1fb80b8a20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1fc8109df0 0x7f1fc819ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc81094a0 0x7f1fc81994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 --2- 172.21.15.29:0/4173149337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc8103b60 0x7f1fc8198f60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 >> 172.21.15.29:0/4173149337 conn(0x7f1fc807b850 msgr2=0x7f1fc8107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 shutdown_connections 2024-09-21T07:09:00.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:00.437+0000 7f1fcedde640 1 -- 172.21.15.29:0/4173149337 wait complete. 2024-09-21T07:09:01.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:00 smithi029 ceph-mon[30983]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:09:01.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:00 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/4173149337' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:01.155 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:09:01.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:00 smithi052 ceph-mon[34308]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:09:01.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:00 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/4173149337' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:00 smithi066 ceph-mon[34793]: pgmap v337: 97 pgs: 97 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:09:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:00 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/4173149337' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:01.414 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 -- 172.21.15.29:0/1787392938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4102100 msgr2=0x7f1bb4102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/1787392938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4102100 0x7f1bb4102510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009900 tx=0x7f1ba402a410 comp rx=0 tx=0).stop 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 -- 172.21.15.29:0/1787392938 shutdown_connections 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/1787392938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bb4109ea0 0x7f1bb41106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/1787392938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb4109550 0x7f1bb4109960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/1787392938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4102100 0x7f1bb4102510 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 -- 172.21.15.29:0/1787392938 >> 172.21.15.29:0/1787392938 conn(0x7f1bb4079ea0 msgr2=0x7f1bb407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 -- 172.21.15.29:0/1787392938 shutdown_connections 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 -- 172.21.15.29:0/1787392938 wait complete. 2024-09-21T07:09:01.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.946+0000 7f1bb9bde640 1 Processor -- start 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb9bde640 1 -- start start 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb9bde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bb4102100 0x7f1bb419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb9bde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb4109550 0x7f1bb419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb9bde640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4109ea0 0x7f1bb419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb9bde640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4113b60 con 0x7f1bb4109ea0 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb9bde640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41139e0 con 0x7f1bb4109550 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb9bde640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4113ce0 con 0x7f1bb4102100 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4109ea0 0x7f1bb419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4109ea0 0x7f1bb419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53636/0 (socket says 172.21.15.29:53636) 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 -- 172.21.15.29:0/586231086 learned_addr learned my addr 172.21.15.29:0/586231086 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb37fe640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bb4102100 0x7f1bb419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:01.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb2ffd640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb4109550 0x7f1bb419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 -- 172.21.15.29:0/586231086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bb4102100 msgr2=0x7f1bb419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bb4102100 0x7f1bb419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 -- 172.21.15.29:0/586231086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb4109550 msgr2=0x7f1bb419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb4109550 0x7f1bb419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.947+0000 7f1bb3fff640 1 -- 172.21.15.29:0/586231086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb41a04e0 con 0x7f1bb4109ea0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.948+0000 7f1bb3fff640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4109ea0 0x7f1bb419fdb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00eaa0 tx=0x7f1bac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.948+0000 7f1bb0ff9640 1 -- 172.21.15.29:0/586231086 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00cdb0 con 0x7f1bb4109ea0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.948+0000 7f1bb0ff9640 1 -- 172.21.15.29:0/586231086 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bac005020 con 0x7f1bb4109ea0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.948+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb41a07d0 con 0x7f1bb4109ea0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.948+0000 7f1bb0ff9640 1 -- 172.21.15.29:0/586231086 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0116d0 con 0x7f1bb4109ea0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.948+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb41a6f30 con 0x7f1bb4109ea0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.949+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb4102510 con 0x7f1bb4109ea0 2024-09-21T07:09:01.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.950+0000 7f1bb0ff9640 1 -- 172.21.15.29:0/586231086 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1bac0051d0 con 0x7f1bb4109ea0 2024-09-21T07:09:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.951+0000 7f1bb0ff9640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1b9c0b6590 0x7f1b9c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.951+0000 7f1bb37fe640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1b9c0b6590 0x7f1b9c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.951+0000 7f1bb0ff9640 1 -- 172.21.15.29:0/586231086 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1bac0e73b0 con 0x7f1bb4109ea0 2024-09-21T07:09:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.952+0000 7f1bb37fe640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1b9c0b6590 0x7f1b9c0b8aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4031440 tx=0x7f1ba4009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:01.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:01.955+0000 7f1bb0ff9640 1 -- 172.21.15.29:0/586231086 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bac016030 con 0x7f1bb4109ea0 2024-09-21T07:09:02.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.186+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bb410bc70 con 0x7f1bb4109ea0 2024-09-21T07:09:02.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.187+0000 7f1bb0ff9640 1 -- 172.21.15.29:0/586231086 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11958 (secure 0 0 0) 0x7f1bac0b1fd0 con 0x7f1bb4109ea0 2024-09-21T07:09:02.191 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:02.192 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"btime":"2024-09-21T07:07:44:626522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:07:44.626498+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:09:02.193 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2024-09-21T07:09:02.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1b9c0b6590 msgr2=0x7f1b9c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:02.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1b9c0b6590 0x7f1b9c0b8aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4031440 tx=0x7f1ba4009560 comp rx=0 tx=0).stop 2024-09-21T07:09:02.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4109ea0 msgr2=0x7f1bb419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4109ea0 0x7f1bb419fdb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00eaa0 tx=0x7f1bac00ef60 comp rx=0 tx=0).stop 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 shutdown_connections 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1b9c0b6590 0x7f1b9c0b8aa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bb4109ea0 0x7f1bb419fdb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb4109550 0x7f1bb419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 --2- 172.21.15.29:0/586231086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bb4102100 0x7f1bb419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 >> 172.21.15.29:0/586231086 conn(0x7f1bb4079ea0 msgr2=0x7f1bb41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 shutdown_connections 2024-09-21T07:09:02.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:02.190+0000 7f1bb9bde640 1 -- 172.21.15.29:0/586231086 wait complete. 2024-09-21T07:09:02.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:07:33.244548+0000', 'modified': '2024-09-21T07:07:44.626498+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24692, 'mds_1': 24655, 'mds_2': 24653, 'mds_3': 24640, 'mds_4': 24629}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14814': {'gid': 14814, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.29:6839/3672589136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6838', 'nonce': 3672589136}, {'type': 'v1', 'addr': '172.21.15.29:6839', 'nonce': 3672589136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14826': {'gid': 14826, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.29:6841/659023126', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6840', 'nonce': 659023126}, {'type': 'v1', 'addr': '172.21.15.29:6841', 'nonce': 659023126}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6833/3104127935', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 3104127935}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 3104127935}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6833/2941334623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 2941334623}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 2941334623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/1200693038', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 1200693038}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 1200693038}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24629': {'gid': 24629, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.52:6835/2243548535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 2243548535}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 2243548535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.66:6837/2021146216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 2021146216}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 2021146216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.52:6837/3446053314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 3446053314}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 3446053314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24655': {'gid': 24655, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.66:6839/3915731427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 3915731427}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 3915731427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24692': {'gid': 24692, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6839/1429145114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 1429145114}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 1429145114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24692, 'qdb_cluster': [24692, 24653, 24640, 24655, 24629]} 2024-09-21T07:09:02.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:09:02.914 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.e status 2024-09-21T07:09:03.178 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:03.299 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:03 smithi029 ceph-mon[30983]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:09:03.299 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:03 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/586231086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:03 smithi066 ceph-mon[34793]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:09:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:03 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/586231086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:03 smithi052 ceph-mon[34308]: pgmap v338: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:09:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:03 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/586231086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 -- 172.21.15.29:0/2731094864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32601094d0 msgr2=0x7f32601098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 --2- 172.21.15.29:0/2731094864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32601094d0 0x7f32601098e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3248009900 tx=0x7f324802a3f0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 -- 172.21.15.29:0/2731094864 shutdown_connections 2024-09-21T07:09:03.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 --2- 172.21.15.29:0/2731094864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3260109e20 0x7f3260110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 --2- 172.21.15.29:0/2731094864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f32601094d0 0x7f32601098e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 --2- 172.21.15.29:0/2731094864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3260103b90 0x7f3260103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 -- 172.21.15.29:0/2731094864 >> 172.21.15.29:0/2731094864 conn(0x7f32600ff600 msgr2=0x7f3260101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 -- 172.21.15.29:0/2731094864 shutdown_connections 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.700+0000 7f3264ea9640 1 -- 172.21.15.29:0/2731094864 wait complete. 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.701+0000 7f3264ea9640 1 Processor -- start 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.701+0000 7f3264ea9640 1 -- start start 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f3264ea9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3260103b90 0x7f326019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f3264ea9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32601094d0 0x7f326019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f3264ea9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3260109e20 0x7f326019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f3264ea9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3260113b30 con 0x7f3260103b90 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f3264ea9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32601139b0 con 0x7f3260109e20 2024-09-21T07:09:03.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f3264ea9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3260113cb0 con 0x7f32601094d0 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3260103b90 0x7f326019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3260103b90 0x7f326019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53652/0 (socket says 172.21.15.29:53652) 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 -- 172.21.15.29:0/695442447 learned_addr learned my addr 172.21.15.29:0/695442447 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f3257fff640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32601094d0 0x7f326019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325ed9d640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3260109e20 0x7f326019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 -- 172.21.15.29:0/695442447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32601094d0 msgr2=0x7f326019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32601094d0 0x7f326019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 -- 172.21.15.29:0/695442447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3260109e20 msgr2=0x7f326019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3260109e20 0x7f326019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 -- 172.21.15.29:0/695442447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32601a0350 con 0x7f3260103b90 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325ed9d640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3260109e20 0x7f326019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f325e59c640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3260103b90 0x7f326019a4a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f325000d950 tx=0x7f325000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:03.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f32577fe640 1 -- 172.21.15.29:0/695442447 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250017070 con 0x7f3260103b90 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f32577fe640 1 -- 172.21.15.29:0/695442447 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3250009c30 con 0x7f3260103b90 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.702+0000 7f32577fe640 1 -- 172.21.15.29:0/695442447 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325000f620 con 0x7f3260103b90 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.703+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32601a0640 con 0x7f3260103b90 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.703+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32601a6e60 con 0x7f3260103b90 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.705+0000 7f326b41d740 1 Processor -- start 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.705+0000 7f326b41d740 1 -- start start 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f32577fe640 1 -- 172.21.15.29:0/695442447 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3250010460 con 0x7f3260103b90 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f326b41d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e241f60 0x564c8e5e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f326b41d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5e8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f326b41d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5e8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f326b41d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564c8e55fc10 con 0x564c8e241f60 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f326b41d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c8e54f040 con 0x564c8e2190a0 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f326b41d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564c8e552e50 con 0x564c8e221280 2024-09-21T07:09:03.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e241f60 0x564c8e5e7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e241f60 0x564c8e5e7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53662/0 (socket says 172.21.15.29:53662) 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 -- 172.21.15.29:0/2869646749 learned_addr learned my addr 172.21.15.29:0/2869646749 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325e59c640 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f3257fff640 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 -- 172.21.15.29:0/2869646749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 msgr2=0x564c8e5e8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5e8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 -- 172.21.15.29:0/2869646749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 msgr2=0x564c8e5e8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5e8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.706+0000 7f325ed9d640 1 -- 172.21.15.29:0/2869646749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8e2ad540 con 0x564c8e241f60 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.707+0000 7f325ed9d640 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e241f60 0x564c8e5e7f00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3258008e60 tx=0x7f325800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342f4c7b49d00707 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.707+0000 7f32577fe640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f324c0b6540 0x7f324c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.707+0000 7f3254ff9640 1 -- 172.21.15.29:0/2869646749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325800f830 con 0x564c8e241f60 2024-09-21T07:09:03.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.707+0000 7f325e59c640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f324c0b6540 0x7f324c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.707+0000 7f3254ff9640 1 -- 172.21.15.29:0/2869646749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3258018480 con 0x564c8e241f60 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.707+0000 7f3254ff9640 1 -- 172.21.15.29:0/2869646749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325800e5f0 con 0x564c8e241f60 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.707+0000 7f32577fe640 1 -- 172.21.15.29:0/695442447 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f32500e6fc0 con 0x7f3260103b90 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 -- 172.21.15.29:0/2869646749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e241f60 msgr2=0x564c8e5e7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f325e59c640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f324c0b6540 0x7f324c0b8a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x564c8e5e6b80 tx=0x7f3250094040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e241f60 0x564c8e5e7f00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3258008e60 tx=0x7f325800d710 comp rx=0 tx=0).stop 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 -- 172.21.15.29:0/2869646749 shutdown_connections 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5e8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 --2- 172.21.15.29:0/2869646749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e241f60 0x564c8e5e7f00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 -- 172.21.15.29:0/2869646749 >> 172.21.15.29:0/2869646749 conn(0x564c8e236350 msgr2=0x564c8e5e5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 -- 172.21.15.29:0/2869646749 shutdown_connections 2024-09-21T07:09:03.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 -- 172.21.15.29:0/2869646749 wait complete. 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.708+0000 7f326b41d740 1 -- start start 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 1 Processor -- start 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e221280 0x564c8e5f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e241f60 0x564c8e5ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564c8e3b05f0 con 0x564c8e221280 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c8e4ea010 con 0x564c8e2190a0 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564c8e5f66e0 con 0x564c8e241f60 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f326b41d740 10 client.0 _ll_register_callbacks cb 0x564c8e549340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e221280 0x564c8e5f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e221280 0x564c8e5f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53672/0 (socket says 172.21.15.29:53672) 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 -- 172.21.15.29:0/3944323922 learned_addr learned my addr 172.21.15.29:0/3944323922 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:03.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e241f60 0x564c8e5ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 -- 172.21.15.29:0/3944323922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e241f60 msgr2=0x564c8e5ff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e241f60 0x564c8e5ff9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 -- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 msgr2=0x564c8e5f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f3257fff640 1 -- 172.21.15.29:0/3944323922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8e517a00 con 0x564c8e221280 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.709+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f3257fff640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e221280 0x564c8e5f3f60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3248006010 tx=0x7f32480053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2ce7175f3ea181 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f3245ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f3245ffb640 1 -- 172.21.15.29:0/3944323922 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248035040 con 0x564c8e221280 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f3245ffb640 1 -- 172.21.15.29:0/3944323922 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f3248004ad0 con 0x564c8e221280 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3258018480 con 0x564c8e221280 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f3245ffb640 1 -- 172.21.15.29:0/3944323922 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3248004cd0 con 0x564c8e221280 2024-09-21T07:09:03.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 10 client.15207 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564c8e602600 con 0x564c8e221280 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f3245ffb640 1 -- 172.21.15.29:0/3944323922 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3258018480 con 0x564c8e221280 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f3245ffb640 1 -- 172.21.15.29:0/3944323922 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f32480314a0 con 0x564c8e221280 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 10 client.15207 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 10 client.15207 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 20 client.15207 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e2008e0 0x564c8e606080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 4 client.15207 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.710+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 --> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c8e561b60 con 0x564c8e2008e0 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.711+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e2008e0 0x564c8e606080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.711+0000 7f3245ffb640 10 client.15207 ms_handle_connect on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.711+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e2008e0 0x564c8e606080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=47e956fb30f6e5ea server_cookie=ce3e63808af6e8b0 in_seq=0 out_seq=0 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f3245ffb640 1 -- 172.21.15.29:0/3944323922 <== mds.4 v2:172.21.15.52:6834/2243548535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c8e561b60 con 0x564c8e2008e0 2024-09-21T07:09:03.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f3245ffb640 10 client.15207 handle_command_reply: tid=0 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 client.15207 shutdown 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e221280 msgr2=0x564c8e5f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e221280 0x564c8e5f3f60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3248006010 tx=0x7f32480053b0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 shutdown_connections 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e2008e0 0x564c8e606080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e241f60 0x564c8e5ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e221280 0x564c8e5f3f60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f3245ffb640 0 client.15207 ms_handle_reset on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 --2- 172.21.15.29:0/3944323922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 >> 172.21.15.29:0/3944323922 conn(0x564c8e236350 msgr2=0x564c8e5eb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 shutdown_connections 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.712+0000 7f326b41d740 1 -- 172.21.15.29:0/3944323922 wait complete. 2024-09-21T07:09:03.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.713+0000 7f326b41d740 20 client.15207 trim_cache size 0 max 16384 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 Processor -- start 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 -- start start 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2008e0 0x564c8e5ff940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5ffe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564c8e6043c0 con 0x564c8e2008e0 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c8e604a90 con 0x564c8e2190a0 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f326b41d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564c8e605160 con 0x564c8e221280 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f325ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2008e0 0x564c8e5ff940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f325ed9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2008e0 0x564c8e5ff940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53676/0 (socket says 172.21.15.29:53676) 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.731+0000 7f325ed9d640 1 -- 172.21.15.29:0/2890325303 learned_addr learned my addr 172.21.15.29:0/2890325303 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:03.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f325ed9d640 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f3257fff640 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5ffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f325ed9d640 1 -- 172.21.15.29:0/2890325303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 msgr2=0x564c8e5f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f325ed9d640 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f325ed9d640 1 -- 172.21.15.29:0/2890325303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 msgr2=0x564c8e5ffe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f325ed9d640 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5ffe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f325ed9d640 1 -- 172.21.15.29:0/2890325303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c8e5f60a0 con 0x564c8e2008e0 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f325ed9d640 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2008e0 0x564c8e5ff940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f325800dc10 tx=0x7f3258018e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680c4c865eb863b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f3247fff640 1 -- 172.21.15.29:0/2890325303 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258021040 con 0x564c8e2008e0 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f3247fff640 1 -- 172.21.15.29:0/2890325303 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3258018930 con 0x564c8e2008e0 2024-09-21T07:09:03.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.732+0000 7f3247fff640 1 -- 172.21.15.29:0/2890325303 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325800fac0 con 0x564c8e2008e0 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 -- 172.21.15.29:0/2890325303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2008e0 msgr2=0x564c8e5ff940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2008e0 0x564c8e5ff940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f325800dc10 tx=0x7f3258018e80 comp rx=0 tx=0).stop 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 -- 172.21.15.29:0/2890325303 shutdown_connections 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2190a0 0x564c8e5ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 --2- 172.21.15.29:0/2890325303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2008e0 0x564c8e5ff940 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 -- 172.21.15.29:0/2890325303 >> 172.21.15.29:0/2890325303 conn(0x564c8e236350 msgr2=0x564c8e5e0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 -- 172.21.15.29:0/2890325303 shutdown_connections 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 -- 172.21.15.29:0/2890325303 wait complete. 2024-09-21T07:09:03.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 -- start start 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.733+0000 7f326b41d740 1 Processor -- start 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f326b41d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2008e0 0x564c8e60ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f326b41d740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2190a0 0x564c8e5f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f326b41d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f326b41d740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564c8e605f00 con 0x564c8e2190a0 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f326b41d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c8e605830 con 0x564c8e2008e0 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f326b41d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564c8e6065d0 con 0x564c8e221280 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f326b41d740 10 client.0 _ll_register_callbacks cb 0x7f3248004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2190a0 0x564c8e5f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2190a0 0x564c8e5f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53692/0 (socket says 172.21.15.29:53692) 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 -- 172.21.15.29:0/3242944034 learned_addr learned my addr 172.21.15.29:0/3242944034 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2008e0 0x564c8e60ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 -- 172.21.15.29:0/3242944034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 msgr2=0x564c8e5f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 -- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2008e0 msgr2=0x564c8e60ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2008e0 0x564c8e60ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 -- 172.21.15.29:0/3242944034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c8e5f16b0 con 0x564c8e2190a0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3257fff640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2190a0 0x564c8e5f0ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3248009850 tx=0x7f3248005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55badec4e804927b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.734+0000 7f3245ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f3245ffb640 1 -- 172.21.15.29:0/3242944034 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248035070 con 0x564c8e2190a0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f3245ffb640 1 -- 172.21.15.29:0/3242944034 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f32480048d0 con 0x564c8e2190a0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3258018930 con 0x564c8e2190a0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f3245ffb640 1 -- 172.21.15.29:0/3242944034 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f324805f050 con 0x564c8e2190a0 2024-09-21T07:09:03.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 10 client.15213 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564c8e6759c0 con 0x564c8e2190a0 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f3245ffb640 1 -- 172.21.15.29:0/3242944034 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3258018930 con 0x564c8e2190a0 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f3245ffb640 1 -- 172.21.15.29:0/3242944034 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3248057020 con 0x564c8e2190a0 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 10 client.15213 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 10 client.15213 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 20 client.15213 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e241f60 0x564c8e679250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 4 client.15213 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.735+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 --> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] -- command(tid 0: {"prefix": "status"}) -- 0x564c8e55d610 con 0x564c8e241f60 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e241f60 0x564c8e679250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f325ed9d640 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e241f60 0x564c8e679250 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=12c34acc5bba9983 server_cookie=ce054c7c43aef3a8 in_seq=0 out_seq=0 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f3245ffb640 10 client.15213 ms_handle_connect on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:03.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f3245ffb640 1 -- 172.21.15.29:0/3242944034 <== mds.4 v2:172.21.15.52:6834/2243548535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564c8e55d610 con 0x564c8e241f60 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f3245ffb640 10 client.15213 handle_command_reply: tid=0 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 client.15213 shutdown 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2190a0 msgr2=0x564c8e5f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2190a0 0x564c8e5f0ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3248009850 tx=0x7f3248005980 comp rx=0 tx=0).stop 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 shutdown_connections 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x564c8e241f60 0x564c8e679250 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564c8e221280 0x564c8e5f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564c8e2190a0 0x564c8e5f0ad0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 --2- 172.21.15.29:0/3242944034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c8e2008e0 0x564c8e60ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.736+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 >> 172.21.15.29:0/3242944034 conn(0x564c8e236350 msgr2=0x564c8e5e0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3245ffb640 0 client.15213 ms_handle_reset on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 shutdown_connections 2024-09-21T07:09:03.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f326b41d740 1 -- 172.21.15.29:0/3242944034 wait complete. 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f326b41d740 20 client.15213 trim_cache size 0 max 16384 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 4, 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24629, 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 80.119546561999996, 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:03.745 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:03.746 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:03.746 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 120.05290807999999 2024-09-21T07:09:03.746 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:03.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f324c0b6540 msgr2=0x7f324c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f324c0b6540 0x7f324c0b8a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x564c8e5e6b80 tx=0x7f3250094040 comp rx=0 tx=0).stop 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3260103b90 msgr2=0x7f326019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3260103b90 0x7f326019a4a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f325000d950 tx=0x7f325000de10 comp rx=0 tx=0).stop 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 shutdown_connections 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f324c0b6540 0x7f324c0b8a50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3260109e20 0x7f326019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32601094d0 0x7f326019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 --2- 172.21.15.29:0/695442447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3260103b90 0x7f326019a4a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 >> 172.21.15.29:0/695442447 conn(0x7f32600ff600 msgr2=0x7f3260101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 shutdown_connections 2024-09-21T07:09:03.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:03.737+0000 7f3264ea9640 1 -- 172.21.15.29:0/695442447 wait complete. 2024-09-21T07:09:04.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:09:04.821 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:05.225 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:05 smithi029 ceph-mon[30983]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T07:09:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.316+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/1862223233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54104a30 msgr2=0x7f4c54104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.316+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/1862223233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54104a30 0x7f4c54104e40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009900 tx=0x7f4c5002a410 comp rx=0 tx=0).stop 2024-09-21T07:09:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.316+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/1862223233 shutdown_connections 2024-09-21T07:09:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.316+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/1862223233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c5410de60 0x7f4c54110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.316+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/1862223233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c54105380 0x7f4c5410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.316+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/1862223233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54104a30 0x7f4c54104e40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.316+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/1862223233 >> 172.21.15.29:0/1862223233 conn(0x7f4c54079760 msgr2=0x7f4c54079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.317+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/1862223233 shutdown_connections 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.317+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/1862223233 wait complete. 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.317+0000 7f4c5bf8b640 1 Processor -- start 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.317+0000 7f4c5bf8b640 1 -- start start 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.317+0000 7f4c5bf8b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c54104a30 0x7f4c5419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5bf8b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54105380 0x7f4c5419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5bf8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c5410de60 0x7f4c5419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5bf8b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54113aa0 con 0x7f4c54105380 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5bf8b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54113920 con 0x7f4c5410de60 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5bf8b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4c54113c20 con 0x7f4c54104a30 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54105380 0x7f4c5419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54105380 0x7f4c5419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53712/0 (socket says 172.21.15.29:53712) 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 -- 172.21.15.29:0/3657648843 learned_addr learned my addr 172.21.15.29:0/3657648843 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59d27640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c54104a30 0x7f4c5419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5a528640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c5410de60 0x7f4c5419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 -- 172.21.15.29:0/3657648843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c54104a30 msgr2=0x7f4c5419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c54104a30 0x7f4c5419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 -- 172.21.15.29:0/3657648843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c5410de60 msgr2=0x7f4c5419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c5410de60 0x7f4c5419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 -- 172.21.15.29:0/3657648843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c541a04a0 con 0x7f4c54105380 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5a528640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c5410de60 0x7f4c5419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c59526640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54105380 0x7f4c5419aad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d740 tx=0x7f4c4800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c46ffd640 1 -- 172.21.15.29:0/3657648843 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48017070 con 0x7f4c54105380 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c541a0790 con 0x7f4c54105380 2024-09-21T07:09:05.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c46ffd640 1 -- 172.21.15.29:0/3657648843 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c4800de50 con 0x7f4c54105380 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.318+0000 7f4c46ffd640 1 -- 172.21.15.29:0/3657648843 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800f620 con 0x7f4c54105380 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.319+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c541a6ef0 con 0x7f4c54105380 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 Processor -- start 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 -- start start 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x563637143f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c46ffd640 1 -- 172.21.15.29:0/3657648843 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4c4801a070 con 0x7f4c54105380 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637144440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637144980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5636370bbc10 con 0x563636d9df60 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5636370ab040 con 0x563636d750a0 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c624ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5636370aee50 con 0x563636d7d280 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c5a528640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x563637143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c5a528640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x563637143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53716/0 (socket says 172.21.15.29:53716) 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.322+0000 7f4c5a528640 1 -- 172.21.15.29:0/988520103 learned_addr learned my addr 172.21.15.29:0/988520103 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c59d27640 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c59526640 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c5a528640 1 -- 172.21.15.29:0/988520103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 msgr2=0x563637144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c5a528640 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c5a528640 1 -- 172.21.15.29:0/988520103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 msgr2=0x563637144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c5a528640 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c5a528640 1 -- 172.21.15.29:0/988520103 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563636e09540 con 0x563636d9df60 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c5a528640 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x563637143f00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c008d50 tx=0x7f4c4c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea54c8339ef7fbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c46ffd640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4c400b6510 0x7f4c400b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c3ffff640 1 -- 172.21.15.29:0/988520103 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00f830 con 0x563636d9df60 2024-09-21T07:09:05.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c3ffff640 1 -- 172.21.15.29:0/988520103 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c4c00de20 con 0x563636d9df60 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c59d27640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4c400b6510 0x7f4c400b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c3ffff640 1 -- 172.21.15.29:0/988520103 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c018d20 con 0x563636d9df60 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.323+0000 7f4c46ffd640 1 -- 172.21.15.29:0/3657648843 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4c480e6d80 con 0x7f4c54105380 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 -- 172.21.15.29:0/988520103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 msgr2=0x563637143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c59d27640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4c400b6510 0x7f4c400b8a20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4c50000c00 tx=0x7f4c50009640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x563637143f00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c008d50 tx=0x7f4c4c00d710 comp rx=0 tx=0).stop 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 -- 172.21.15.29:0/988520103 shutdown_connections 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 --2- 172.21.15.29:0/988520103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x563637143f00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 -- 172.21.15.29:0/988520103 >> 172.21.15.29:0/988520103 conn(0x563636d92350 msgr2=0x563637141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 -- 172.21.15.29:0/988520103 shutdown_connections 2024-09-21T07:09:05.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.324+0000 7f4c624ff740 1 -- 172.21.15.29:0/988520103 wait complete. 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 -- start start 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 Processor -- start 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d750a0 0x56363714f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d7d280 0x56363714fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d9df60 0x56363715ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563636f0c5f0 con 0x563636d7d280 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563637046010 con 0x563636d9df60 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563637152730 con 0x563636d750a0 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.325+0000 7f4c624ff740 10 client.0 _ll_register_callbacks cb 0x5636370a5340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d7d280 0x56363714fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d7d280 0x56363714fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53726/0 (socket says 172.21.15.29:53726) 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 -- 172.21.15.29:0/837412328 learned_addr learned my addr 172.21.15.29:0/837412328 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59d27640 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d750a0 0x56363714f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c5a528640 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d9df60 0x56363715ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 -- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d750a0 msgr2=0x56363714f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d750a0 0x56363714f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 -- 172.21.15.29:0/837412328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d9df60 msgr2=0x56363715ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d9df60 0x56363715ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 -- 172.21.15.29:0/837412328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563637073a00 con 0x563636d7d280 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c59526640 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d7d280 0x56363714fd30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009610 tx=0x7f4c480ea3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e24c54e279f501 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/837412328 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48021070 con 0x563636d7d280 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/837412328 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4c480942d0 con 0x563636d7d280 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c4c00de20 con 0x563636d7d280 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/837412328 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4c480ac870 con 0x563636d7d280 2024-09-21T07:09:05.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c624ff740 10 client.15225 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.326+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56363715e5c0 con 0x563636d7d280 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/837412328 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c4c00de20 con 0x563636d7d280 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/837412328 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4c480abbf0 con 0x563636d7d280 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c624ff740 10 client.15225 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c624ff740 10 client.15225 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c624ff740 20 client.15225 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c624ff740 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d5c8e0 0x563637162040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c624ff740 4 client.15225 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 --> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636370bdb60 con 0x563636d5c8e0 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.327+0000 7f4c59d27640 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d5c8e0 0x563637162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.328+0000 7f4c3d7fa640 10 client.15225 ms_handle_connect on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.328+0000 7f4c59d27640 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d5c8e0 0x563637162040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=be17d0d622c2f1af server_cookie=5ade01c1df16392 in_seq=0 out_seq=0 2024-09-21T07:09:05.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/837412328 <== mds.3 v2:172.21.15.66:6836/2021146216 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5636370bdb60 con 0x563636d5c8e0 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c3d7fa640 10 client.15225 handle_command_reply: tid=0 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 client.15225 shutdown 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d7d280 msgr2=0x56363714fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d7d280 0x56363714fd30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009610 tx=0x7f4c480ea3b0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 shutdown_connections 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d5c8e0 0x563637162040 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d9df60 0x56363715ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d7d280 0x56363714fd30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 --2- 172.21.15.29:0/837412328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d750a0 0x56363714f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c3d7fa640 0 client.15225 ms_handle_reset on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 >> 172.21.15.29:0/837412328 conn(0x563636d92350 msgr2=0x563637144f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 shutdown_connections 2024-09-21T07:09:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 1 -- 172.21.15.29:0/837412328 wait complete. 2024-09-21T07:09:05.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.329+0000 7f4c624ff740 20 client.15225 trim_cache size 0 max 16384 2024-09-21T07:09:05.355 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:05 smithi066 ceph-mon[34793]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 Processor -- start 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 -- start start 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d750a0 0x56363714a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d7d280 0x56363715b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d9df60 0x56363715bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563637160380 con 0x563636d750a0 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563637160a50 con 0x563636d7d280 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c624ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563637161120 con 0x563636d9df60 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d750a0 0x56363714a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d750a0 0x56363714a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53730/0 (socket says 172.21.15.29:53730) 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 -- 172.21.15.29:0/2379594302 learned_addr learned my addr 172.21.15.29:0/2379594302 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59526640 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d7d280 0x56363715b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c5a528640 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d9df60 0x56363715bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 -- 172.21.15.29:0/2379594302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d9df60 msgr2=0x56363715bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d9df60 0x56363715bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 -- 172.21.15.29:0/2379594302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d7d280 msgr2=0x56363715b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d7d280 0x56363715b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.348+0000 7f4c59d27640 1 -- 172.21.15.29:0/2379594302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563637146790 con 0x563636d750a0 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.349+0000 7f4c59d27640 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d750a0 0x56363714a020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406c8f0 tx=0x7f4c5003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d798d0dd852a896 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.349+0000 7f4c3f7fe640 1 -- 172.21.15.29:0/2379594302 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50035040 con 0x563636d750a0 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.349+0000 7f4c3f7fe640 1 -- 172.21.15.29:0/2379594302 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c50055070 con 0x563636d750a0 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.349+0000 7f4c3f7fe640 1 -- 172.21.15.29:0/2379594302 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5003c6a0 con 0x563636d750a0 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 -- 172.21.15.29:0/2379594302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d750a0 msgr2=0x56363714a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d750a0 0x56363714a020 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4c5406c8f0 tx=0x7f4c5003e000 comp rx=0 tx=0).stop 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 -- 172.21.15.29:0/2379594302 shutdown_connections 2024-09-21T07:09:05.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d9df60 0x56363715bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d7d280 0x56363715b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 --2- 172.21.15.29:0/2379594302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d750a0 0x56363714a020 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 -- 172.21.15.29:0/2379594302 >> 172.21.15.29:0/2379594302 conn(0x563636d92350 msgr2=0x56363714a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 -- 172.21.15.29:0/2379594302 shutdown_connections 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 -- 172.21.15.29:0/2379594302 wait complete. 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 -- start start 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.350+0000 7f4c624ff740 1 Processor -- start 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637163460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637163a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c624ff740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x5636371ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c624ff740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x563637161ec0 con 0x563636d9df60 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c624ff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5636371617f0 con 0x563636d750a0 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c624ff740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563637162590 con 0x563636d7d280 2024-09-21T07:09:05.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c624ff740 10 client.0 _ll_register_callbacks cb 0x7f4c48009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x5636371ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x5636371ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53732/0 (socket says 172.21.15.29:53732) 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 -- 172.21.15.29:0/535852591 learned_addr learned my addr 172.21.15.29:0/535852591 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c59526640 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637163a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c59d27640 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637163460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 -- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 msgr2=0x563637163a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637163a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 -- 172.21.15.29:0/535852591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 msgr2=0x563637163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637163460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 -- 172.21.15.29:0/535852591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636371cabf0 con 0x563636d9df60 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c5a528640 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x5636371ca580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e010 tx=0x7f4c4c008ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65620ed17bef2d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.351+0000 7f4c3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:05.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/535852591 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c028020 con 0x563636d9df60 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/535852591 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f4c4c018c60 con 0x563636d9df60 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c50055070 con 0x563636d9df60 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/535852591 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4c4c00f630 con 0x563636d9df60 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 10 client.15231 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5636371d1f10 con 0x563636d9df60 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/535852591 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c50055070 con 0x563636d9df60 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/535852591 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4c4c0247f0 con 0x563636d9df60 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 10 client.15231 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 10 client.15231 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 20 client.15231 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d31c90 0x5636371d5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 4 client.15231 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 --> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] -- command(tid 0: {"prefix": "status"}) -- 0x5636370b9610 con 0x563636d31c90 2024-09-21T07:09:05.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.352+0000 7f4c59d27640 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d31c90 0x5636371d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c59d27640 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d31c90 0x5636371d5480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=90536a61678f0445 server_cookie=8ba02c7ad3122752 in_seq=0 out_seq=0 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c3d7fa640 10 client.15231 ms_handle_connect on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c3d7fa640 1 -- 172.21.15.29:0/535852591 <== mds.3 v2:172.21.15.66:6836/2021146216 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5636370b9610 con 0x563636d31c90 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c3d7fa640 10 client.15231 handle_command_reply: tid=0 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 client.15231 shutdown 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 msgr2=0x5636371ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x5636371ca580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00e010 tx=0x7f4c4c008ac0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 shutdown_connections 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563636d9df60 0x5636371ca580 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563636d7d280 0x563637163a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x563636d31c90 0x5636371d5480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 --2- 172.21.15.29:0/535852591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563636d750a0 0x563637163460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 >> 172.21.15.29:0/535852591 conn(0x563636d92350 msgr2=0x5636371416e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.353+0000 7f4c3d7fa640 0 client.15231 ms_handle_reset on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 shutdown_connections 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c624ff740 1 -- 172.21.15.29:0/535852591 wait complete. 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c624ff740 20 client.15231 trim_cache size 0 max 16384 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 3, 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24640, 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:05.366 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:05.367 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 82.742767990000004, 2024-09-21T07:09:05.367 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:05.367 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:05.367 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:05.367 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 116.63452989699999 2024-09-21T07:09:05.367 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4c400b6510 msgr2=0x7f4c400b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4c400b6510 0x7f4c400b8a20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4c50000c00 tx=0x7f4c50009640 comp rx=0 tx=0).stop 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54105380 msgr2=0x7f4c5419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54105380 0x7f4c5419aad0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800d740 tx=0x7f4c4800dc00 comp rx=0 tx=0).stop 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 shutdown_connections 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4c400b6510 0x7f4c400b8a20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c5410de60 0x7f4c5419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c54105380 0x7f4c5419aad0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 --2- 172.21.15.29:0/3657648843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c54104a30 0x7f4c5419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 >> 172.21.15.29:0/3657648843 conn(0x7f4c54079760 msgr2=0x7f4c540ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 shutdown_connections 2024-09-21T07:09:05.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:05.354+0000 7f4c5bf8b640 1 -- 172.21.15.29:0/3657648843 wait complete. 2024-09-21T07:09:05.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:05 smithi052 ceph-mon[34308]: pgmap v339: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-21T07:09:06.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T07:09:06.591 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 -- 172.21.15.29:0/583390073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1930109df0 msgr2=0x7f1930110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 --2- 172.21.15.29:0/583390073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1930109df0 0x7f1930110620 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1928009ca0 tx=0x7f192802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 -- 172.21.15.29:0/583390073 shutdown_connections 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 --2- 172.21.15.29:0/583390073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1930109df0 0x7f1930110620 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 --2- 172.21.15.29:0/583390073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19301094a0 0x7f19301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 --2- 172.21.15.29:0/583390073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1930103b60 0x7f1930103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 -- 172.21.15.29:0/583390073 >> 172.21.15.29:0/583390073 conn(0x7f193007b850 msgr2=0x7f193007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 -- 172.21.15.29:0/583390073 shutdown_connections 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.116+0000 7f1937ad2640 1 -- 172.21.15.29:0/583390073 wait complete. 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 Processor -- start 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 -- start start 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1930103b60 0x7f193019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19301094a0 0x7f193019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1930109df0 0x7f193019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1930113ab0 con 0x7f19301094a0 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1930113930 con 0x7f1930103b60 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f1937ad2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1930113c30 con 0x7f1930109df0 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f193506d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19301094a0 0x7f193019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f193506d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19301094a0 0x7f193019a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53750/0 (socket says 172.21.15.29:53750) 2024-09-21T07:09:07.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f193506d640 1 -- 172.21.15.29:0/3309094120 learned_addr learned my addr 172.21.15.29:0/3309094120 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f193606f640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1930109df0 0x7f193019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.117+0000 7f193586e640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1930103b60 0x7f193019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f193506d640 1 -- 172.21.15.29:0/3309094120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1930109df0 msgr2=0x7f193019fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f193506d640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1930109df0 0x7f193019fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f193506d640 1 -- 172.21.15.29:0/3309094120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1930103b60 msgr2=0x7f193019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f193506d640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1930103b60 0x7f193019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f193506d640 1 -- 172.21.15.29:0/3309094120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19301a0390 con 0x7f19301094a0 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f193586e640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1930103b60 0x7f193019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f193506d640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19301094a0 0x7f193019a9c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f192000c970 tx=0x7f192000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f1926ffd640 1 -- 172.21.15.29:0/3309094120 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920007bb0 con 0x7f19301094a0 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19301a0680 con 0x7f19301094a0 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f1926ffd640 1 -- 172.21.15.29:0/3309094120 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1920007d50 con 0x7f19301094a0 2024-09-21T07:09:07.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f1926ffd640 1 -- 172.21.15.29:0/3309094120 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920004e10 con 0x7f19301094a0 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.118+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19301a6de0 con 0x7f19301094a0 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 Processor -- start 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 -- start start 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f1926ffd640 1 -- 172.21.15.29:0/3309094120 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1920005000 con 0x7f19301094a0 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436312f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436313440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436313980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x56043628ac10 con 0x560435f440a0 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56043627a040 con 0x560435f6cf60 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193e046740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56043627de50 con 0x560435f4c280 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.121+0000 7f193586e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436313440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436313440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53758/0 (socket says 172.21.15.29:53758) 2024-09-21T07:09:07.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 -- 172.21.15.29:0/2797468844 learned_addr learned my addr 172.21.15.29:0/2797468844 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193606f640 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436312f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193506d640 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436313980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 -- 172.21.15.29:0/2797468844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 msgr2=0x560436313980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436313980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 -- 172.21.15.29:0/2797468844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 msgr2=0x560436312f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436312f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 -- 172.21.15.29:0/2797468844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560435fd8540 con 0x560435f440a0 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f1926ffd640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f191c0b6510 0x7f191c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193586e640 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436313440 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f192c00bd40 tx=0x7f192c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4915a8533566728e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f193606f640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f191c0b6510 0x7f191c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f1926ffd640 1 -- 172.21.15.29:0/3309094120 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f19200e7020 con 0x7f19301094a0 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f191bfff640 1 -- 172.21.15.29:0/2797468844 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c015070 con 0x560435f440a0 2024-09-21T07:09:07.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f191bfff640 1 -- 172.21.15.29:0/2797468844 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f192c01a910 con 0x560435f440a0 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.122+0000 7f191bfff640 1 -- 172.21.15.29:0/2797468844 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c011980 con 0x560435f440a0 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193e046740 1 -- 172.21.15.29:0/2797468844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 msgr2=0x560436313440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193606f640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f191c0b6510 0x7f191c0b8a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1928006010 tx=0x7f192802f310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193e046740 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436313440 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f192c00bd40 tx=0x7f192c00f730 comp rx=0 tx=0).stop 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193e046740 1 -- 172.21.15.29:0/2797468844 shutdown_connections 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193e046740 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436313980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193e046740 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436313440 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193e046740 1 --2- 172.21.15.29:0/2797468844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436312f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.123+0000 7f193e046740 1 -- 172.21.15.29:0/2797468844 >> 172.21.15.29:0/2797468844 conn(0x560435f61350 msgr2=0x560436310df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.124+0000 7f193e046740 1 -- 172.21.15.29:0/2797468844 shutdown_connections 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.124+0000 7f193e046740 1 -- 172.21.15.29:0/2797468844 wait complete. 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.124+0000 7f193e046740 1 -- start start 2024-09-21T07:09:07.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.124+0000 7f193e046740 1 Processor -- start 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.124+0000 7f193e046740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436322b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.124+0000 7f193e046740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436323150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193e046740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x56043632edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193e046740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5604360db5f0 con 0x560435f440a0 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193e046740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560436215010 con 0x560435f6cf60 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193e046740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560436325a40 con 0x560435f4c280 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193e046740 10 client.0 _ll_register_callbacks cb 0x560436274340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436322b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436322b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53770/0 (socket says 172.21.15.29:53770) 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 -- 172.21.15.29:0/4154030476 learned_addr learned my addr 172.21.15.29:0/4154030476 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193506d640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436323150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193606f640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x56043632edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 -- 172.21.15.29:0/4154030476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 msgr2=0x560436323150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436323150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 -- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 msgr2=0x56043632edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x56043632edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 -- 172.21.15.29:0/4154030476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560436242a00 con 0x560435f440a0 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193606f640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x56043632edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f193586e640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436322b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f192c011480 tx=0x7f192c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18428b2910728f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f19197fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.125+0000 7f19197fa640 1 -- 172.21.15.29:0/4154030476 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c015050 con 0x560435f440a0 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f19197fa640 1 -- 172.21.15.29:0/4154030476 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f192c01aac0 con 0x560435f440a0 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f192c01a910 con 0x560435f440a0 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f19197fa640 1 -- 172.21.15.29:0/4154030476 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f192c01acc0 con 0x560435f440a0 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 10 client.15243 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:07.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560436331980 con 0x560435f440a0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f19197fa640 1 -- 172.21.15.29:0/4154030476 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f192c01a910 con 0x560435f440a0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f19197fa640 1 -- 172.21.15.29:0/4154030476 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f192c023070 con 0x560435f440a0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 10 client.15243 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 20 client.15243 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f2b8e0 0x5604363350a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 4 client.15243 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.126+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 --> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56043628cb60 con 0x560435f2b8e0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.127+0000 7f193506d640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f2b8e0 0x5604363350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.127+0000 7f193506d640 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f2b8e0 0x5604363350a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d99fa3f799107bc2 server_cookie=f26e273971ed8dee in_seq=0 out_seq=0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.127+0000 7f19197fa640 10 client.15243 ms_handle_connect on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f19197fa640 1 -- 172.21.15.29:0/4154030476 <== mds.2 v2:172.21.15.52:6836/3446053314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f192008df90 con 0x560435f2b8e0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f19197fa640 10 client.15243 handle_command_reply: tid=0 2024-09-21T07:09:07.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 client.15243 shutdown 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 msgr2=0x560436322b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436322b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f192c011480 tx=0x7f192c005850 comp rx=0 tx=0).stop 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 shutdown_connections 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f2b8e0 0x5604363350a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x56043632edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436323150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f19197fa640 0 client.15243 ms_handle_reset on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 --2- 172.21.15.29:0/4154030476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x560436322b90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 >> 172.21.15.29:0/4154030476 conn(0x560435f61350 msgr2=0x5604363148f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 shutdown_connections 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 1 -- 172.21.15.29:0/4154030476 wait complete. 2024-09-21T07:09:07.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.128+0000 7f193e046740 20 client.15243 trim_cache size 0 max 16384 2024-09-21T07:09:07.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 Processor -- start 2024-09-21T07:09:07.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 -- start start 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f440a0 0x560436333c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f4c280 0x560436317f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x5604363184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5604363333e0 con 0x560435f4c280 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560436333ab0 con 0x560435f6cf60 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193e046740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560436334180 con 0x560435f440a0 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193506d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f4c280 0x560436317f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193506d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f4c280 0x560436317f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53784/0 (socket says 172.21.15.29:53784) 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193506d640 1 -- 172.21.15.29:0/641068234 learned_addr learned my addr 172.21.15.29:0/641068234 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193606f640 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x5604363184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.147+0000 7f193586e640 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f440a0 0x560436333c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f193506d640 1 -- 172.21.15.29:0/641068234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f440a0 msgr2=0x560436333c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f193506d640 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f440a0 0x560436333c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f193506d640 1 -- 172.21.15.29:0/641068234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 msgr2=0x5604363184b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f193506d640 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x5604363184b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f193506d640 1 -- 172.21.15.29:0/641068234 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560436323e50 con 0x560435f4c280 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f193586e640 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f440a0 0x560436333c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f193506d640 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f4c280 0x560436317f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f19200e4b30 tx=0x7f1920004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1beeb59639ecdf4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f191b7fe640 1 -- 172.21.15.29:0/641068234 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192001d040 con 0x560435f4c280 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f191b7fe640 1 -- 172.21.15.29:0/641068234 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56043628cb60 con 0x560435f4c280 2024-09-21T07:09:07.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.148+0000 7f191b7fe640 1 -- 172.21.15.29:0/641068234 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200a9430 con 0x560435f4c280 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 -- 172.21.15.29:0/641068234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f4c280 msgr2=0x560436317f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f4c280 0x560436317f70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f19200e4b30 tx=0x7f1920004830 comp rx=0 tx=0).stop 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 -- 172.21.15.29:0/641068234 shutdown_connections 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x5604363184b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f4c280 0x560436317f70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 --2- 172.21.15.29:0/641068234 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f440a0 0x560436333c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 -- 172.21.15.29:0/641068234 >> 172.21.15.29:0/641068234 conn(0x560435f61350 msgr2=0x56043632ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 -- 172.21.15.29:0/641068234 shutdown_connections 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 -- 172.21.15.29:0/641068234 wait complete. 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 -- start start 2024-09-21T07:09:07.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.149+0000 7f193e046740 1 Processor -- start 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193e046740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x56043633dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193e046740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436337880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193e046740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436337f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193e046740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x560436334f20 con 0x560435f440a0 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193e046740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560436334850 con 0x560435f6cf60 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193e046740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5604363355f0 con 0x560435f4c280 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193e046740 10 client.0 _ll_register_callbacks cb 0x7f1928009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x56043633dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x56043633dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53788/0 (socket says 172.21.15.29:53788) 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 -- 172.21.15.29:0/3462660285 learned_addr learned my addr 172.21.15.29:0/3462660285 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193606f640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436337f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193506d640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436337880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 -- 172.21.15.29:0/3462660285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 msgr2=0x560436337880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436337880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 -- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 msgr2=0x560436337f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436337f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193586e640 1 -- 172.21.15.29:0/3462660285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560436338690 con 0x560435f440a0 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193506d640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436337880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.150+0000 7f193606f640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436337f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f193586e640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x56043633dce0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f192c00f770 tx=0x7f192c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c6ea6f63788ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f19197fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f19197fa640 1 -- 172.21.15.29:0/3462660285 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c03d060 con 0x560435f440a0 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56043628cb60 con 0x560435f440a0 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f19197fa640 1 -- 172.21.15.29:0/3462660285 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f192c01a870 con 0x560435f440a0 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f19197fa640 1 -- 172.21.15.29:0/3462660285 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f192c015070 con 0x560435f440a0 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f193e046740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:07.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5604363a0630 con 0x560435f440a0 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f19197fa640 1 -- 172.21.15.29:0/3462660285 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56043628cb60 con 0x560435f440a0 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.151+0000 7f19197fa640 1 -- 172.21.15.29:0/3462660285 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f192c023040 con 0x560435f440a0 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193e046740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193e046740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193e046740 20 client.15249 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193e046740 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f00c90 0x5604363a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193e046740 4 client.15249 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 --> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] -- command(tid 0: {"prefix": "status"}) -- 0x560436288610 con 0x560435f00c90 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193506d640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f00c90 0x5604363a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193506d640 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f00c90 0x5604363a3eb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93657e2b8ae91dcf server_cookie=66f516afad760f15 in_seq=0 out_seq=0 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f19197fa640 10 client.15249 ms_handle_connect on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f19197fa640 1 -- 172.21.15.29:0/3462660285 <== mds.2 v2:172.21.15.52:6836/3446053314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560436288610 con 0x560435f00c90 2024-09-21T07:09:07.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f19197fa640 10 client.15249 handle_command_reply: tid=0 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.152+0000 7f193e046740 1 client.15249 shutdown 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 msgr2=0x56043633dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x56043633dce0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f192c00f770 tx=0x7f192c005710 comp rx=0 tx=0).stop 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 shutdown_connections 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x560435f00c90 0x5604363a3eb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560435f6cf60 0x560436337f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560435f4c280 0x560436337880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f19197fa640 0 client.15249 ms_handle_reset on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 --2- 172.21.15.29:0/3462660285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x560435f440a0 0x56043633dce0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 >> 172.21.15.29:0/3462660285 conn(0x560435f61350 msgr2=0x560436317f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 shutdown_connections 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 1 -- 172.21.15.29:0/3462660285 wait complete. 2024-09-21T07:09:07.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f193e046740 20 client.15249 trim_cache size 0 max 16384 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 2, 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24653, 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 85.550693663000004, 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:07.160 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:07.161 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 115.71434763000001 2024-09-21T07:09:07.161 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:07.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f191c0b6510 msgr2=0x7f191c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f1937ad2640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f191c0b6510 0x7f191c0b8a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1928006010 tx=0x7f192802f310 comp rx=0 tx=0).stop 2024-09-21T07:09:07.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19301094a0 msgr2=0x7f193019a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:07.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.153+0000 7f1937ad2640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19301094a0 0x7f193019a9c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f192000c970 tx=0x7f192000ce30 comp rx=0 tx=0).stop 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 shutdown_connections 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f191c0b6510 0x7f191c0b8a20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1930109df0 0x7f193019fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19301094a0 0x7f193019a9c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 --2- 172.21.15.29:0/3309094120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1930103b60 0x7f193019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 >> 172.21.15.29:0/3309094120 conn(0x7f193007b850 msgr2=0x7f1930107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 shutdown_connections 2024-09-21T07:09:07.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:07.154+0000 7f1937ad2640 1 -- 172.21.15.29:0/3309094120 wait complete. 2024-09-21T07:09:07.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:07 smithi066 ceph-mon[34793]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T07:09:07.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:07 smithi029 ceph-mon[30983]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T07:09:07.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:07 smithi052 ceph-mon[34308]: pgmap v340: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-21T07:09:07.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:09:08.235 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:08.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 -- 172.21.15.29:0/587597077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78108d70 msgr2=0x7f2d7810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/587597077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78108d70 0x7f2d7810f5a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2d70009ca0 tx=0x7f2d7002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 -- 172.21.15.29:0/587597077 shutdown_connections 2024-09-21T07:09:08.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/587597077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78108d70 0x7f2d7810f5a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/587597077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d78108420 0x7f2d78108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/587597077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d78102ae0 0x7f2d78102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 -- 172.21.15.29:0/587597077 >> 172.21.15.29:0/587597077 conn(0x7f2d78079770 msgr2=0x7f2d78079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 -- 172.21.15.29:0/587597077 shutdown_connections 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.739+0000 7f2d7cb13640 1 -- 172.21.15.29:0/587597077 wait complete. 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 Processor -- start 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 -- start start 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78102ae0 0x7f2d7819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d78108420 0x7f2d7819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d78108d70 0x7f2d7819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2d78112a30 con 0x7f2d78102ae0 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d781128b0 con 0x7f2d78108420 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7cb13640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2d78112bb0 con 0x7f2d78108d70 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78102ae0 0x7f2d7819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78102ae0 0x7f2d7819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44272/0 (socket says 172.21.15.29:44272) 2024-09-21T07:09:08.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d7659c640 1 -- 172.21.15.29:0/489953247 learned_addr learned my addr 172.21.15.29:0/489953247 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.740+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d78108420 0x7f2d7819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d78108d70 0x7f2d7819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7659c640 1 -- 172.21.15.29:0/489953247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d78108d70 msgr2=0x7f2d7819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7659c640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d78108d70 0x7f2d7819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7659c640 1 -- 172.21.15.29:0/489953247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d78108420 msgr2=0x7f2d7819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7659c640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d78108420 0x7f2d7819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7659c640 1 -- 172.21.15.29:0/489953247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d781a0420 con 0x7f2d78102ae0 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7659c640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78102ae0 0x7f2d7819a4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800d950 tx=0x7f2d6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d677fe640 1 -- 172.21.15.29:0/489953247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68017070 con 0x7f2d78102ae0 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d677fe640 1 -- 172.21.15.29:0/489953247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d68009c30 con 0x7f2d78102ae0 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d781a0710 con 0x7f2d78102ae0 2024-09-21T07:09:08.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d677fe640 1 -- 172.21.15.29:0/489953247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800f620 con 0x7f2d78102ae0 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.741+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d781a6e70 con 0x7f2d78102ae0 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 Processor -- start 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 -- start start 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d677fe640 1 -- 172.21.15.29:0/489953247 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2d68010460 con 0x7f2d78102ae0 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb71f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb72440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb72980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eefdae9c10 con 0x55eefd7ab280 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eefdad9040 con 0x55eefd7cbf60 2024-09-21T07:09:08.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d83087740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eefdadce50 con 0x55eefd7a30a0 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb72980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb72980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44280/0 (socket says 172.21.15.29:44280) 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3928002093 learned_addr learned my addr 172.21.15.29:0/3928002093 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.744+0000 7f2d76d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb71f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d7659c640 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb72440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3928002093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 msgr2=0x55eefdb72440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb72440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3928002093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 msgr2=0x55eefdb71f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb71f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3928002093 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefd837540 con 0x55eefd7ab280 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb72980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00bc30 tx=0x7f2d6c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ed3646f1590e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:08.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d677fe640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d600b6510 0x7f2d600b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d64ff9640 1 -- 172.21.15.29:0/3928002093 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c01c480 con 0x55eefd7ab280 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d64ff9640 1 -- 172.21.15.29:0/3928002093 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c01cad0 con 0x55eefd7ab280 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d64ff9640 1 -- 172.21.15.29:0/3928002093 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c011a40 con 0x55eefd7ab280 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d600b6510 0x7f2d600b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.745+0000 7f2d677fe640 1 -- 172.21.15.29:0/489953247 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2d680e6f30 con 0x7f2d78102ae0 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d600b6510 0x7f2d600b8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d70006010 tx=0x7f2d70009440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 -- 172.21.15.29:0/3928002093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 msgr2=0x55eefdb72980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb72980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00bc30 tx=0x7f2d6c0107a0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 -- 172.21.15.29:0/3928002093 shutdown_connections 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb72980 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb72440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 --2- 172.21.15.29:0/3928002093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb71f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 -- 172.21.15.29:0/3928002093 >> 172.21.15.29:0/3928002093 conn(0x55eefd7c0350 msgr2=0x55eefdb6fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 -- 172.21.15.29:0/3928002093 shutdown_connections 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.746+0000 7f2d83087740 1 -- 172.21.15.29:0/3928002093 wait complete. 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 -- start start 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 Processor -- start 2024-09-21T07:09:08.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb7da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb7df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb89a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eefd93a5f0 con 0x55eefd7ab280 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eefda74010 con 0x55eefd7cbf60 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eefdb806e0 con 0x55eefd7a30a0 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d83087740 10 client.0 _ll_register_callbacks cb 0x55eefdad3340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb7df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb7df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44286/0 (socket says 172.21.15.29:44286) 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.747+0000 7f2d75d9b640 1 -- 172.21.15.29:0/4288022352 learned_addr learned my addr 172.21.15.29:0/4288022352 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d7659c640 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb7da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb89a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d75d9b640 1 -- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 msgr2=0x55eefdb7da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb7da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d75d9b640 1 -- 172.21.15.29:0/4288022352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 msgr2=0x55eefdb89a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb89a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d75d9b640 1 -- 172.21.15.29:0/4288022352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefdaa1a00 con 0x55eefd7ab280 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb7df40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c000c00 tx=0x7f2d6c0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c37866bf1f90c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d5dffb640 1 -- 172.21.15.29:0/4288022352 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c02b060 con 0x55eefd7ab280 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d5dffb640 1 -- 172.21.15.29:0/4288022352 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2d6c01c480 con 0x55eefd7ab280 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6c01cad0 con 0x55eefd7ab280 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d5dffb640 1 -- 172.21.15.29:0/4288022352 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2d6c01c680 con 0x55eefd7ab280 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d83087740 10 client.15261 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.748+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eefdb8c670 con 0x55eefd7ab280 2024-09-21T07:09:08.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d5dffb640 1 -- 172.21.15.29:0/4288022352 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c01cad0 con 0x55eefd7ab280 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d5dffb640 1 -- 172.21.15.29:0/4288022352 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2d6c011950 con 0x55eefd7ab280 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d83087740 10 client.15261 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d83087740 10 client.15261 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d83087740 20 client.15261 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d83087740 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd78a8e0 0x55eefdb8fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d83087740 4 client.15261 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 --> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eefdaebb60 con 0x55eefd78a8e0 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.749+0000 7f2d7659c640 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd78a8e0 0x55eefdb8fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.750+0000 7f2d7659c640 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd78a8e0 0x55eefdb8fde0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1bc875049bd3c099 server_cookie=c816affdf2a13727 in_seq=0 out_seq=0 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.750+0000 7f2d5dffb640 10 client.15261 ms_handle_connect on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.750+0000 7f2d5dffb640 1 -- 172.21.15.29:0/4288022352 <== mds.1 v2:172.21.15.66:6838/3915731427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eefdaebb60 con 0x55eefd78a8e0 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.750+0000 7f2d5dffb640 10 client.15261 handle_command_reply: tid=0 2024-09-21T07:09:08.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.750+0000 7f2d83087740 1 client.15261 shutdown 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 msgr2=0x55eefdb7df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb7df40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c000c00 tx=0x7f2d6c0114b0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 shutdown_connections 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd78a8e0 0x55eefdb8fde0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7cbf60 0x55eefdb89a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb7df40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 --2- 172.21.15.29:0/4288022352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7a30a0 0x55eefdb7da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 >> 172.21.15.29:0/4288022352 conn(0x55eefd7c0350 msgr2=0x55eefdb75090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d5dffb640 0 client.15261 ms_handle_reset on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 shutdown_connections 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 1 -- 172.21.15.29:0/4288022352 wait complete. 2024-09-21T07:09:08.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.751+0000 7f2d83087740 20 client.15261 trim_cache size 0 max 16384 2024-09-21T07:09:08.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.769+0000 7f2d83087740 1 Processor -- start 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.769+0000 7f2d83087740 1 -- start start 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.769+0000 7f2d83087740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb77ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d83087740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb89970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d83087740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7cbf60 0x55eefdb89eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d83087740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eefdb8e120 con 0x55eefd7ab280 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d83087740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eefdb8e7f0 con 0x55eefd7a30a0 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d83087740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eefdb8eec0 con 0x55eefd7cbf60 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb89970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb89970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44298/0 (socket says 172.21.15.29:44298) 2024-09-21T07:09:08.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3330329753 learned_addr learned my addr 172.21.15.29:0/3330329753 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7cbf60 0x55eefdb89eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d7659c640 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb77ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3330329753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7cbf60 msgr2=0x55eefdb89eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7cbf60 0x55eefdb89eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3330329753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 msgr2=0x55eefdb77ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb77ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 -- 172.21.15.29:0/3330329753 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefdb706e0 con 0x55eefd7ab280 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d7659c640 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb77ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb89970 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c010 tx=0x7f2d6c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53edfe648bfa533d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d5ffff640 1 -- 172.21.15.29:0/3330329753 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c036070 con 0x55eefd7ab280 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d5ffff640 1 -- 172.21.15.29:0/3330329753 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c0119d0 con 0x55eefd7ab280 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.770+0000 7f2d5ffff640 1 -- 172.21.15.29:0/3330329753 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c02b030 con 0x55eefd7ab280 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 -- 172.21.15.29:0/3330329753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 msgr2=0x55eefdb89970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb89970 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c00c010 tx=0x7f2d6c011f90 comp rx=0 tx=0).stop 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 -- 172.21.15.29:0/3330329753 shutdown_connections 2024-09-21T07:09:08.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7cbf60 0x55eefdb89eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7ab280 0x55eefdb89970 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 --2- 172.21.15.29:0/3330329753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb77ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 -- 172.21.15.29:0/3330329753 >> 172.21.15.29:0/3330329753 conn(0x55eefd7c0350 msgr2=0x55eefdb789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 -- 172.21.15.29:0/3330329753 shutdown_connections 2024-09-21T07:09:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.771+0000 7f2d83087740 1 -- 172.21.15.29:0/3330329753 wait complete. 2024-09-21T07:09:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 -- start start 2024-09-21T07:09:08.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 Processor -- start 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7ab280 0x55eefdb91c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7cbf60 0x55eefdb921b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55eefdb8fc60 con 0x55eefd7cbf60 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eefdb8f590 con 0x55eefd7a30a0 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eefdb90330 con 0x55eefd7ab280 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d83087740 10 client.0 _ll_register_callbacks cb 0x7f2d70009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d76d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7cbf60 0x55eefdb921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7ab280 0x55eefdb91c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d76d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7cbf60 0x55eefdb921b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44310/0 (socket says 172.21.15.29:44310) 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:34352/0 (socket says 172.21.15.29:34352) 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d76d9d640 1 -- 172.21.15.29:0/3740987749 learned_addr learned my addr 172.21.15.29:0/3740987749 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.772+0000 7f2d75d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7ab280 0x55eefdb91c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.29:59840/0 (socket says 172.21.15.29:59840) 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d76d9d640 1 -- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7ab280 msgr2=0x55eefdb91c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7ab280 0x55eefdb91c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d76d9d640 1 -- 172.21.15.29:0/3740987749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 msgr2=0x55eefdb987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d76d9d640 1 -- 172.21.15.29:0/3740987749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefdb928a0 con 0x55eefd7cbf60 2024-09-21T07:09:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d75d9b640 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7ab280 0x55eefdb91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:09:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d76d9d640 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7cbf60 0x55eefdb921b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2d70035000 tx=0x7f2d700095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e03c4f79b0e955 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:08.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d5dffb640 1 -- 172.21.15.29:0/3740987749 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70058060 con 0x55eefd7cbf60 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d5dffb640 1 -- 172.21.15.29:0/3740987749 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2d70004250 con 0x55eefd7cbf60 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6c0119d0 con 0x55eefd7cbf60 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d5dffb640 1 -- 172.21.15.29:0/3740987749 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2d700318e0 con 0x55eefd7cbf60 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d83087740 10 client.15267 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eefdbfb2b0 con 0x55eefd7cbf60 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.773+0000 7f2d5dffb640 1 -- 172.21.15.29:0/3740987749 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c0119d0 con 0x55eefd7cbf60 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d5dffb640 1 -- 172.21.15.29:0/3740987749 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2d700305c0 con 0x55eefd7cbf60 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d83087740 10 client.15267 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d83087740 10 client.15267 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d83087740 20 client.15267 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d83087740 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd75fc90 0x55eefdbfead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d83087740 4 client.15267 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:08.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 --> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] -- command(tid 0: {"prefix": "status"}) -- 0x55eefdae7610 con 0x55eefd75fc90 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.774+0000 7f2d7659c640 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd75fc90 0x55eefdbfead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d7659c640 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd75fc90 0x55eefdbfead0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=467871c5010a00d4 server_cookie=e2d25928b4713a01 in_seq=0 out_seq=0 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d5dffb640 10 client.15267 ms_handle_connect on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d5dffb640 1 -- 172.21.15.29:0/3740987749 <== mds.1 v2:172.21.15.66:6838/3915731427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55eefdae7610 con 0x55eefd75fc90 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d5dffb640 10 client.15267 handle_command_reply: tid=0 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 client.15267 shutdown 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7cbf60 msgr2=0x55eefdb921b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7cbf60 0x55eefdb921b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2d70035000 tx=0x7f2d700095c0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 shutdown_connections 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55eefd75fc90 0x55eefdbfead0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55eefd7cbf60 0x55eefdb921b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eefd7ab280 0x55eefdb91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d5dffb640 0 client.15267 ms_handle_reset on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:08.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 --2- 172.21.15.29:0/3740987749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eefd7a30a0 0x55eefdb987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 >> 172.21.15.29:0/3740987749 conn(0x55eefd7c0350 msgr2=0x55eefdb7bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 shutdown_connections 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 1 -- 172.21.15.29:0/3740987749 wait complete. 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.775+0000 7f2d83087740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 1, 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24655, 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 88.180783399999996, 2024-09-21T07:09:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 114.769592582 2024-09-21T07:09:08.794 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:08.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d600b6510 msgr2=0x7f2d600b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d600b6510 0x7f2d600b8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2d70006010 tx=0x7f2d70009440 comp rx=0 tx=0).stop 2024-09-21T07:09:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78102ae0 msgr2=0x7f2d7819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78102ae0 0x7f2d7819a4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800d950 tx=0x7f2d6800de10 comp rx=0 tx=0).stop 2024-09-21T07:09:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 shutdown_connections 2024-09-21T07:09:08.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2d600b6510 0x7f2d600b8a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2d78108d70 0x7f2d7819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d78108420 0x7f2d7819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 --2- 172.21.15.29:0/489953247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d78102ae0 0x7f2d7819a4b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:08.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 >> 172.21.15.29:0/489953247 conn(0x7f2d78079770 msgr2=0x7f2d78101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:08.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 shutdown_connections 2024-09-21T07:09:08.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:08.776+0000 7f2d7cb13640 1 -- 172.21.15.29:0/489953247 wait complete. 2024-09-21T07:09:09.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:09 smithi066 ceph-mon[34793]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:09:09.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:09 smithi029 ceph-mon[30983]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:09:09.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:09 smithi052 ceph-mon[34308]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-21T07:09:09.610 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:09:09.869 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 -- 172.21.15.29:0/2933174741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6738103b60 msgr2=0x7f6738103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 --2- 172.21.15.29:0/2933174741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6738103b60 0x7f6738103f70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f672c009900 tx=0x7f672c02a410 comp rx=0 tx=0).stop 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 -- 172.21.15.29:0/2933174741 shutdown_connections 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 --2- 172.21.15.29:0/2933174741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738109df0 0x7f6738110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 --2- 172.21.15.29:0/2933174741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67381094a0 0x7f67381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 --2- 172.21.15.29:0/2933174741 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6738103b60 0x7f6738103f70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 -- 172.21.15.29:0/2933174741 >> 172.21.15.29:0/2933174741 conn(0x7f673807b850 msgr2=0x7f673807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:10.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 -- 172.21.15.29:0/2933174741 shutdown_connections 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.336+0000 7f673eac6640 1 -- 172.21.15.29:0/2933174741 wait complete. 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 Processor -- start 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 -- start start 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103b60 0x7f673819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67381094a0 0x7f673819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6738109df0 0x7f673819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6738113ab0 con 0x7f67381094a0 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6738113930 con 0x7f6738103b60 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f673eac6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6738113c30 con 0x7f6738109df0 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.337+0000 7f6737fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67381094a0 0x7f673819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67381094a0 0x7f673819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44336/0 (socket says 172.21.15.29:44336) 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 -- 172.21.15.29:0/3589701274 learned_addr learned my addr 172.21.15.29:0/3589701274 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f673c862640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103b60 0x7f673819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f673d063640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6738109df0 0x7f673819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 -- 172.21.15.29:0/3589701274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6738109df0 msgr2=0x7f673819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6738109df0 0x7f673819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 -- 172.21.15.29:0/3589701274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103b60 msgr2=0x7f673819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103b60 0x7f673819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 -- 172.21.15.29:0/3589701274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67381a0490 con 0x7f67381094a0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6737fff640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67381094a0 0x7f673819aac0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f672400c970 tx=0x7f672400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6735ffb640 1 -- 172.21.15.29:0/3589701274 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724004220 con 0x7f67381094a0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67381a0780 con 0x7f67381094a0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6735ffb640 1 -- 172.21.15.29:0/3589701274 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67240043c0 con 0x7f67381094a0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f6735ffb640 1 -- 172.21.15.29:0/3589701274 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724004a00 con 0x7f67381094a0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.338+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67381a6ee0 con 0x7f67381094a0 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 Processor -- start 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 -- start start 2024-09-21T07:09:10.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f6735ffb640 1 -- 172.21.15.29:0/3589701274 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f67240079b0 con 0x7f67381094a0 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185833f60 0x564185bd9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bda440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185813280 0x564185bda980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564185b51c10 con 0x564185813280 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564185b41040 con 0x56418580b0a0 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.341+0000 7f674503a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564185b44e50 con 0x564185833f60 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185813280 0x564185bda980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185813280 0x564185bda980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44340/0 (socket says 172.21.15.29:44340) 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 -- 172.21.15.29:0/1842285195 learned_addr learned my addr 172.21.15.29:0/1842285195 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f673c862640 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bda440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f673d063640 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185833f60 0x564185bd9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 -- 172.21.15.29:0/1842285195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185833f60 msgr2=0x564185bd9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185833f60 0x564185bd9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 -- 172.21.15.29:0/1842285195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 msgr2=0x564185bda440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bda440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 -- 172.21.15.29:0/1842285195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56418589f540 con 0x564185813280 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6735ffb640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f67280b6510 0x7f67280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6737fff640 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185813280 0x564185bda980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f67240ef1b0 tx=0x7f67240ef670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c77061922872eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f673d063640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f67280b6510 0x7f67280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6722ffd640 1 -- 172.21.15.29:0/1842285195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240a9840 con 0x564185813280 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6735ffb640 1 -- 172.21.15.29:0/3589701274 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f67240e6fa0 con 0x7f67381094a0 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6722ffd640 1 -- 172.21.15.29:0/1842285195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67240056a0 con 0x564185813280 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.342+0000 7f6722ffd640 1 -- 172.21.15.29:0/1842285195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240c2040 con 0x564185813280 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 -- 172.21.15.29:0/1842285195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185813280 msgr2=0x564185bda980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185813280 0x564185bda980 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f67240ef1b0 tx=0x7f67240ef670 comp rx=0 tx=0).stop 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f673d063640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f67280b6510 0x7f67280b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6730005fd0 tx=0x7f67300096a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 -- 172.21.15.29:0/1842285195 shutdown_connections 2024-09-21T07:09:10.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185813280 0x564185bda980 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bda440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 --2- 172.21.15.29:0/1842285195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185833f60 0x564185bd9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 -- 172.21.15.29:0/1842285195 >> 172.21.15.29:0/1842285195 conn(0x564185828350 msgr2=0x564185bd7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 -- 172.21.15.29:0/1842285195 shutdown_connections 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.343+0000 7f674503a740 1 -- 172.21.15.29:0/1842285195 wait complete. 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 -- start start 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 Processor -- start 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185be59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185be5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185833f60 0x564185bf1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5641859a25f0 con 0x564185833f60 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564185adc010 con 0x56418580b0a0 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564185be8620 con 0x564185813280 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.344+0000 7f674503a740 10 client.0 _ll_register_callbacks cb 0x564185b3b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:10.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185833f60 0x564185bf1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673c862640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185be59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185833f60 0x564185bf1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44356/0 (socket says 172.21.15.29:44356) 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 -- 172.21.15.29:0/3885834481 learned_addr learned my addr 172.21.15.29:0/3885834481 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673c862640 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185be59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:34382/0 (socket says 172.21.15.29:34382) 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f6737fff640 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185be5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 -- 172.21.15.29:0/3885834481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 msgr2=0x564185be5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185be5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 -- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 msgr2=0x564185be59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185be59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 -- 172.21.15.29:0/3885834481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564185b09a00 con 0x564185833f60 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f673d063640 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185833f60 0x564185bf1910 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f67300107c0 tx=0x7f6730004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d2a71fb26c3132 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f6717fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:10.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f6717fff640 1 -- 172.21.15.29:0/3885834481 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730004b20 con 0x564185833f60 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f6717fff640 1 -- 172.21.15.29:0/3885834481 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6730017030 con 0x564185833f60 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67240056a0 con 0x564185833f60 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f6717fff640 1 -- 172.21.15.29:0/3885834481 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6730004cc0 con 0x564185833f60 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f674503a740 10 client.15279 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.345+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564185bf4570 con 0x564185833f60 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f6717fff640 1 -- 172.21.15.29:0/3885834481 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67240056a0 con 0x564185833f60 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f6717fff640 1 -- 172.21.15.29:0/3885834481 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6730027a90 con 0x564185833f60 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f674503a740 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f674503a740 10 client.15279 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f674503a740 20 client.15279 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f674503a740 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x5641857f28e0 0x564185bf8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f674503a740 4 client.15279 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 --> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564185b53b60 con 0x5641857f28e0 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.346+0000 7f673c862640 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x5641857f28e0 0x564185bf8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.347+0000 7f6717fff640 10 client.15279 ms_handle_connect on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.347+0000 7f673c862640 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x5641857f28e0 0x564185bf8050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=380fc313c5625c96 server_cookie=c5eaba80538bdb in_seq=0 out_seq=0 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f6717fff640 1 -- 172.21.15.29:0/3885834481 <== mds.0 v2:172.21.15.52:6838/1429145114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564185b53b60 con 0x5641857f28e0 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f6717fff640 10 client.15279 handle_command_reply: tid=0 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 client.15279 shutdown 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185833f60 msgr2=0x564185bf1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185833f60 0x564185bf1910 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f67300107c0 tx=0x7f6730004ab0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 shutdown_connections 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x564185833f60 0x564185bf1910 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x5641857f28e0 0x564185bf8050 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185be5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 --2- 172.21.15.29:0/3885834481 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185be59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f6717fff640 0 client.15279 ms_handle_reset on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 >> 172.21.15.29:0/3885834481 conn(0x564185828350 msgr2=0x564185bdaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:10.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 shutdown_connections 2024-09-21T07:09:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 1 -- 172.21.15.29:0/3885834481 wait complete. 2024-09-21T07:09:10.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.348+0000 7f674503a740 20 client.15279 trim_cache size 0 max 16384 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 Processor -- start 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 -- start start 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641857f28e0 0x564185bf1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56418580b0a0 0x564185bf1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564185813280 0x564185bd77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564185bf6390 con 0x56418580b0a0 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564185bf6a60 con 0x564185813280 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f674503a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564185bf7130 con 0x5641857f28e0 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56418580b0a0 0x564185bf1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56418580b0a0 0x564185bf1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44358/0 (socket says 172.21.15.29:44358) 2024-09-21T07:09:10.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 -- 172.21.15.29:0/4225672607 learned_addr learned my addr 172.21.15.29:0/4225672607 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 -- 172.21.15.29:0/4225672607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641857f28e0 msgr2=0x564185bf1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641857f28e0 0x564185bf1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 -- 172.21.15.29:0/4225672607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564185813280 msgr2=0x564185bd77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f673d063640 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564185813280 0x564185bd77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564185813280 0x564185bd77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f6737fff640 1 -- 172.21.15.29:0/4225672607 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564185be66e0 con 0x56418580b0a0 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.367+0000 7f673d063640 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564185813280 0x564185bd77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.368+0000 7f6737fff640 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56418580b0a0 0x564185bf1dc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f67240efb70 tx=0x7f6724005350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7496b586d2b1076 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.368+0000 7f67227fc640 1 -- 172.21.15.29:0/4225672607 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672401d070 con 0x56418580b0a0 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.368+0000 7f67227fc640 1 -- 172.21.15.29:0/4225672607 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67240056a0 con 0x56418580b0a0 2024-09-21T07:09:10.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.368+0000 7f67227fc640 1 -- 172.21.15.29:0/4225672607 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67240c2210 con 0x56418580b0a0 2024-09-21T07:09:10.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 -- 172.21.15.29:0/4225672607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56418580b0a0 msgr2=0x564185bf1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56418580b0a0 0x564185bf1dc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f67240efb70 tx=0x7f6724005350 comp rx=0 tx=0).stop 2024-09-21T07:09:10.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 -- 172.21.15.29:0/4225672607 shutdown_connections 2024-09-21T07:09:10.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564185813280 0x564185bd77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56418580b0a0 0x564185bf1dc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 --2- 172.21.15.29:0/4225672607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5641857f28e0 0x564185bf1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 -- 172.21.15.29:0/4225672607 >> 172.21.15.29:0/4225672607 conn(0x564185828350 msgr2=0x564185be0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 -- 172.21.15.29:0/4225672607 shutdown_connections 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 -- 172.21.15.29:0/4225672607 wait complete. 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 -- start start 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.369+0000 7f674503a740 1 Processor -- start 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f674503a740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641857f28e0 0x564185c00a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f674503a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bf9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f674503a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185bfa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f674503a740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x564185bf7ed0 con 0x5641857f28e0 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f674503a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564185bf7800 con 0x56418580b0a0 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f674503a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564185bf85a0 con 0x564185813280 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f674503a740 10 client.0 _ll_register_callbacks cb 0x7f6730010650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:10.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641857f28e0 0x564185c00a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641857f28e0 0x564185c00a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44366/0 (socket says 172.21.15.29:44366) 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 -- 172.21.15.29:0/3035948668 learned_addr learned my addr 172.21.15.29:0/3035948668 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673d063640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185bfa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f6737fff640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bf9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 -- 172.21.15.29:0/3035948668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 msgr2=0x564185bfa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185bfa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 -- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 msgr2=0x564185bf9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bf9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 -- 172.21.15.29:0/3035948668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564185bfabf0 con 0x5641857f28e0 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f6737fff640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bf9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f673c862640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641857f28e0 0x564185c00a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f672c009900 tx=0x7f672c0327e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2334bda32a49e187 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.370+0000 7f6717fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:10.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f6717fff640 1 -- 172.21.15.29:0/3035948668 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c035040 con 0x5641857f28e0 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f6717fff640 1 -- 172.21.15.29:0/3035948668 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f672c004450 con 0x5641857f28e0 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67240056a0 con 0x5641857f28e0 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f6717fff640 1 -- 172.21.15.29:0/3035948668 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f672c005040 con 0x5641857f28e0 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 10 client.15285 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564185c63520 con 0x5641857f28e0 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f6717fff640 1 -- 172.21.15.29:0/3035948668 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67240056a0 con 0x5641857f28e0 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f6717fff640 1 -- 172.21.15.29:0/3035948668 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f672c0035f0 con 0x5641857f28e0 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 20 client.15285 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x564185833f60 0x564185c66ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 4 client.15285 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:10.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 --> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] -- command(tid 0: {"prefix": "status"}) -- 0x564185b4f610 con 0x564185833f60 2024-09-21T07:09:10.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.371+0000 7f6737fff640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x564185833f60 0x564185c66ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:10.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f6737fff640 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x564185833f60 0x564185c66ca0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90541e7b43ec61ca server_cookie=66e2175d6f514b4e in_seq=0 out_seq=0 2024-09-21T07:09:10.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f6717fff640 10 client.15285 ms_handle_connect on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:10.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f6717fff640 1 -- 172.21.15.29:0/3035948668 <== mds.0 v2:172.21.15.52:6838/1429145114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564185b4f610 con 0x564185833f60 2024-09-21T07:09:10.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f6717fff640 10 client.15285 handle_command_reply: tid=0 2024-09-21T07:09:10.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 client.15285 shutdown 2024-09-21T07:09:10.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641857f28e0 msgr2=0x564185c00a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641857f28e0 0x564185c00a70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f672c009900 tx=0x7f672c0327e0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 shutdown_connections 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x564185833f60 0x564185c66ca0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564185813280 0x564185bfa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56418580b0a0 0x564185bf9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 --2- 172.21.15.29:0/3035948668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5641857f28e0 0x564185c00a70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 >> 172.21.15.29:0/3035948668 conn(0x564185828350 msgr2=0x564185bd7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f6717fff640 0 client.15285 ms_handle_reset on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.372+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 shutdown_connections 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f674503a740 1 -- 172.21.15.29:0/3035948668 wait complete. 2024-09-21T07:09:10.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f674503a740 20 client.15285 trim_cache size 0 max 16384 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24692, 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:10.381 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 96.809878642000001, 2024-09-21T07:09:10.382 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:10.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:10.382 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:10.382 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 106.496110582 2024-09-21T07:09:10.382 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:10.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f67280b6510 msgr2=0x7f67280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f67280b6510 0x7f67280b8a20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6730005fd0 tx=0x7f67300096a0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67381094a0 msgr2=0x7f673819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:10.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67381094a0 0x7f673819aac0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f672400c970 tx=0x7f672400ce30 comp rx=0 tx=0).stop 2024-09-21T07:09:10.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 shutdown_connections 2024-09-21T07:09:10.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f67280b6510 0x7f67280b8a20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6738109df0 0x7f673819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67381094a0 0x7f673819aac0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 --2- 172.21.15.29:0/3589701274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103b60 0x7f673819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 >> 172.21.15.29:0/3589701274 conn(0x7f673807b850 msgr2=0x7f6738107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 shutdown_connections 2024-09-21T07:09:10.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:10.373+0000 7f673eac6640 1 -- 172.21.15.29:0/3589701274 wait complete. 2024-09-21T07:09:11.190 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T07:09:11.190 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:09:11.199 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T07:09:11.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T07:09:11.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:11 smithi066 ceph-mon[34793]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:09:11.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:11 smithi029 ceph-mon[30983]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:09:11.460 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:11.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:11 smithi052 ceph-mon[34308]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2977925184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a8102690 msgr2=0x7f91a8102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2977925184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a8102690 0x7f91a8102b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9198009ca0 tx=0x7f919802a950 comp rx=0 tx=0).stop 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2977925184 shutdown_connections 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2977925184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91a81040c0 0x7f91a810aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2977925184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91a8103720 0x7f91a8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2977925184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a8102690 0x7f91a8102b00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2977925184 >> 172.21.15.29:0/2977925184 conn(0x7f91a80fe000 msgr2=0x7f91a81004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2977925184 shutdown_connections 2024-09-21T07:09:11.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2977925184 wait complete. 2024-09-21T07:09:11.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.972+0000 7f91ae0d5640 1 Processor -- start 2024-09-21T07:09:11.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91ae0d5640 1 -- start start 2024-09-21T07:09:11.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91ae0d5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91a8102690 0x7f91a810cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91ae0d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91a8103720 0x7f91a810b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91ae0d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a81040c0 0x7f91a810bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91ae0d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f91a810f400 con 0x7f91a81040c0 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91ae0d5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91a810f280 con 0x7f91a8102690 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91ae0d5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f91a810f580 con 0x7f91a8103720 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a81040c0 0x7f91a810bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91a8102690 0x7f91a810cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91a7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a81040c0 0x7f91a810bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44378/0 (socket says 172.21.15.29:44378) 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91a7fff640 1 -- 172.21.15.29:0/2328261045 learned_addr learned my addr 172.21.15.29:0/2328261045 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.973+0000 7f91a6ffd640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91a8103720 0x7f91a810b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a77fe640 1 -- 172.21.15.29:0/2328261045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91a8103720 msgr2=0x7f91a810b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a77fe640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91a8103720 0x7f91a810b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a77fe640 1 -- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a81040c0 msgr2=0x7f91a810bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:11.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a77fe640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a81040c0 0x7f91a810bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a77fe640 1 -- 172.21.15.29:0/2328261045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a810c250 con 0x7f91a8102690 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a7fff640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a81040c0 0x7f91a810bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a77fe640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91a8102690 0x7f91a810cdd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9198006010 tx=0x7f919802fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a4ff9640 1 -- 172.21.15.29:0/2328261045 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198034040 con 0x7f91a8102690 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a4ff9640 1 -- 172.21.15.29:0/2328261045 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91980308f0 con 0x7f91a8102690 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a810c4e0 con 0x7f91a8102690 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91a4ff9640 1 -- 172.21.15.29:0/2328261045 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198045480 con 0x7f91a8102690 2024-09-21T07:09:11.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.974+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a81a4390 con 0x7f91a8102690 2024-09-21T07:09:11.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.975+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a8109870 con 0x7f91a8102690 2024-09-21T07:09:11.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.977+0000 7f91a4ff9640 1 -- 172.21.15.29:0/2328261045 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9198037020 con 0x7f91a8102690 2024-09-21T07:09:11.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.977+0000 7f91a4ff9640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f91940b6510 0x7f91940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:11.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.977+0000 7f91a6ffd640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f91940b6510 0x7f91940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:11.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.978+0000 7f91a4ff9640 1 -- 172.21.15.29:0/2328261045 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f91981084b0 con 0x7f91a8102690 2024-09-21T07:09:11.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.978+0000 7f91a6ffd640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f91940b6510 0x7f91940b8a20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f919000bbe0 tx=0x7f919000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:11.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:11.981+0000 7f91a4ff9640 1 -- 172.21.15.29:0/2328261045 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91980cede0 con 0x7f91a8102690 2024-09-21T07:09:12.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.186+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f91a8063800 con 0x7f91940b6510 2024-09-21T07:09:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.188+0000 7f91a4ff9640 1 -- 172.21.15.29:0/2328261045 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f91a8063800 con 0x7f91940b6510 2024-09-21T07:09:12.189 INFO:teuthology.orchestra.run.smithi029.stdout:Backend: cephadm 2024-09-21T07:09:12.189 INFO:teuthology.orchestra.run.smithi029.stdout:Available: Yes 2024-09-21T07:09:12.189 INFO:teuthology.orchestra.run.smithi029.stdout:Paused: No 2024-09-21T07:09:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f91940b6510 msgr2=0x7f91940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f91940b6510 0x7f91940b8a20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f919000bbe0 tx=0x7f919000b390 comp rx=0 tx=0).stop 2024-09-21T07:09:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91a8102690 msgr2=0x7f91a810cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91a8102690 0x7f91a810cdd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9198006010 tx=0x7f919802fba0 comp rx=0 tx=0).stop 2024-09-21T07:09:12.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 shutdown_connections 2024-09-21T07:09:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f91940b6510 0x7f91940b8a20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f91a81040c0 0x7f91a810bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91a8103720 0x7f91a810b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 --2- 172.21.15.29:0/2328261045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91a8102690 0x7f91a810cdd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.190+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 >> 172.21.15.29:0/2328261045 conn(0x7f91a80fe000 msgr2=0x7f91a8106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.191+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 shutdown_connections 2024-09-21T07:09:12.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:12.191+0000 7f91ae0d5640 1 -- 172.21.15.29:0/2328261045 wait complete. 2024-09-21T07:09:12.931 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T07:09:13.193 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:13.314 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:13 smithi029 ceph-mon[30983]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:09:13.314 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:13 smithi029 ceph-mon[30983]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:13 smithi066 ceph-mon[34793]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:09:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:13 smithi066 ceph-mon[34793]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:13.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:13 smithi052 ceph-mon[34308]: pgmap v343: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T07:09:13.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:13 smithi052 ceph-mon[34308]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 -- 172.21.15.29:0/87853534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43081047e0 msgr2=0x7f4308104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 --2- 172.21.15.29:0/87853534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43081047e0 0x7f4308104bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009900 tx=0x7f42f802a480 comp rx=0 tx=0).stop 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 -- 172.21.15.29:0/87853534 shutdown_connections 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 --2- 172.21.15.29:0/87853534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4308105180 0x7f430810bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 --2- 172.21.15.29:0/87853534 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43081047e0 0x7f4308104bf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 --2- 172.21.15.29:0/87853534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4308103750 0x7f4308103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 -- 172.21.15.29:0/87853534 >> 172.21.15.29:0/87853534 conn(0x7f43080ff0c0 msgr2=0x7f4308101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:13.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 -- 172.21.15.29:0/87853534 shutdown_connections 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 -- 172.21.15.29:0/87853534 wait complete. 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 Processor -- start 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.681+0000 7f430f6d9640 1 -- start start 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430f6d9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4308103750 0x7f4308199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430f6d9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43081047e0 0x7f430819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430f6d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4308105180 0x7f430819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430f6d9640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f430810f380 con 0x7f4308103750 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430f6d9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f430810f200 con 0x7f43081047e0 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430f6d9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f430810f500 con 0x7f4308105180 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4308103750 0x7f4308199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4308103750 0x7f4308199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44396/0 (socket says 172.21.15.29:44396) 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 -- 172.21.15.29:0/2905183874 learned_addr learned my addr 172.21.15.29:0/2905183874 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:13.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430dc76640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4308105180 0x7f430819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430cc74640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43081047e0 0x7f430819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 -- 172.21.15.29:0/2905183874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4308105180 msgr2=0x7f430819b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4308105180 0x7f430819b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 -- 172.21.15.29:0/2905183874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43081047e0 msgr2=0x7f430819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43081047e0 0x7f430819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 -- 172.21.15.29:0/2905183874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430819b980 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430cc74640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43081047e0 0x7f430819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430d475640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4308103750 0x7f4308199fe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f430400c920 tx=0x7f430400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f42fe7fc640 1 -- 172.21.15.29:0/2905183874 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304007c70 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.682+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430819bc70 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.683+0000 7f42fe7fc640 1 -- 172.21.15.29:0/2905183874 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4304007e10 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.683+0000 7f42fe7fc640 1 -- 172.21.15.29:0/2905183874 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304018820 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.683+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43081a2400 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.684+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430810a930 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.685+0000 7f42fe7fc640 1 -- 172.21.15.29:0/2905183874 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f430400f450 con 0x7f4308103750 2024-09-21T07:09:13.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.686+0000 7f42fe7fc640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f42f40b6510 0x7f42f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:13.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.686+0000 7f430cc74640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f42f40b6510 0x7f42f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:13.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.686+0000 7f42fe7fc640 1 -- 172.21.15.29:0/2905183874 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f43040e7700 con 0x7f4308103750 2024-09-21T07:09:13.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.687+0000 7f430cc74640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f42f40b6510 0x7f42f40b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42f8005f70 tx=0x7f42f8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:13.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.689+0000 7f42fe7fc640 1 -- 172.21.15.29:0/2905183874 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4304014030 con 0x7f4308103750 2024-09-21T07:09:13.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.890+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4308063800 con 0x7f42f40b6510 2024-09-21T07:09:13.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.902+0000 7f42fe7fc640 1 -- 172.21.15.29:0/2905183874 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f4308063800 con 0x7f42f40b6510 2024-09-21T07:09:13.904 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T07:09:13.904 INFO:teuthology.orchestra.run.smithi029.stdout:mds.a smithi029 running (113s) 23s ago 112s 85.0M - 19.3.0-5120-g18432218 ddce307e1f32 941437d44383 2024-09-21T07:09:13.904 INFO:teuthology.orchestra.run.smithi029.stdout:mds.b smithi052 running (110s) 41s ago 109s 93.6M - 19.3.0-5120-g18432218 ddce307e1f32 e0dcd70689bd 2024-09-21T07:09:13.904 INFO:teuthology.orchestra.run.smithi029.stdout:mds.c smithi066 running (2m) 41s ago 2m 85.8M - 19.3.0-5120-g18432218 ddce307e1f32 543836303f1a 2024-09-21T07:09:13.904 INFO:teuthology.orchestra.run.smithi029.stdout:mds.d smithi029 running (2m) 23s ago 2m 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 6b5c3cfd63fc 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.e smithi052 running (2m) 41s ago 2m 88.3M - 19.3.0-5120-g18432218 ddce307e1f32 834b2ca3bb2d 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.f smithi066 running (2m) 41s ago 2m 88.1M - 19.3.0-5120-g18432218 ddce307e1f32 29fd867fb3be 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.g smithi029 running (117s) 23s ago 116s 85.5M - 19.3.0-5120-g18432218 ddce307e1f32 982831d42121 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.h smithi052 running (2m) 41s ago 2m 85.0M - 19.3.0-5120-g18432218 ddce307e1f32 49a5c53e6256 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.i smithi066 running (2m) 41s ago 119s 86.0M - 19.3.0-5120-g18432218 ddce307e1f32 a44ed3600f5a 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.j smithi029 running (2m) 23s ago 2m 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 faabcc6a09e4 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.k smithi052 running (2m) 41s ago 2m 84.9M - 19.3.0-5120-g18432218 ddce307e1f32 2116dc47abe4 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mds.l smithi066 running (2m) 41s ago 2m 85.0M - 19.3.0-5120-g18432218 ddce307e1f32 979f5ce93d60 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi029 *:9283,8765 running (10m) 23s ago 9m 591M - 19.3.0-5120-g18432218 ddce307e1f32 f32a34e381bd 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi052 *:8443,8765 running (8m) 41s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 3ba520efe0b1 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.z smithi066 *:8443,8765 running (8m) 41s ago 8m 523M - 19.3.0-5120-g18432218 ddce307e1f32 8e9c418118ec 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (10m) 23s ago 10m 122M 2048M 19.3.0-5120-g18432218 ddce307e1f32 c2727873ade0 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi052 running (8m) 41s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 d9e3857f419c 2024-09-21T07:09:13.905 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi066 running (8m) 41s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 ab75bd0e71fc 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (7m) 23s ago 7m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 3ee723cdf938 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi052 running (6m) 41s ago 6m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 00d191ccd178 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi066 running (6m) 41s ago 6m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 30103e0bd497 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (6m) 23s ago 6m 115M 4273M 19.3.0-5120-g18432218 ddce307e1f32 e92bce3c5135 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi052 running (5m) 41s ago 5m 120M 4273M 19.3.0-5120-g18432218 ddce307e1f32 34d4a86b18f8 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi066 running (5m) 41s ago 5m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 af51b2cd5167 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi029 running (4m) 23s ago 4m 121M 4273M 19.3.0-5120-g18432218 ddce307e1f32 26d7005958e4 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi052 running (4m) 41s ago 4m 116M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7b6fa3df11ca 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.8 smithi066 running (3m) 41s ago 3m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 e444e42a5a9d 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.9 smithi029 running (3m) 23s ago 3m 112M 4273M 19.3.0-5120-g18432218 ddce307e1f32 44e8b1ce0834 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.10 smithi052 running (3m) 41s ago 3m 122M 4273M 19.3.0-5120-g18432218 ddce307e1f32 99ef9f521488 2024-09-21T07:09:13.906 INFO:teuthology.orchestra.run.smithi029.stdout:osd.11 smithi066 running (2m) 41s ago 2m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 772e6411bb16 2024-09-21T07:09:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f42f40b6510 msgr2=0x7f42f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f42f40b6510 0x7f42f40b8a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42f8005f70 tx=0x7f42f8000bc0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4308103750 msgr2=0x7f4308199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4308103750 0x7f4308199fe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f430400c920 tx=0x7f430400cde0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 shutdown_connections 2024-09-21T07:09:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f42f40b6510 0x7f42f40b8a20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4308105180 0x7f430819b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43081047e0 0x7f430819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 --2- 172.21.15.29:0/2905183874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4308103750 0x7f4308199fe0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 >> 172.21.15.29:0/2905183874 conn(0x7f43080ff0c0 msgr2=0x7f4308107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 shutdown_connections 2024-09-21T07:09:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:13.905+0000 7f430f6d9640 1 -- 172.21.15.29:0/2905183874 wait complete. 2024-09-21T07:09:14.666 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T07:09:14.927 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:15.316 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:15 smithi029 ceph-mon[30983]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:15.316 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:15 smithi029 ceph-mon[30983]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:15.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:15 smithi066 ceph-mon[34793]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:15.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:15 smithi066 ceph-mon[34793]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 -- 172.21.15.29:0/1769957911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa908108d00 msgr2=0x7fa90810b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 --2- 172.21.15.29:0/1769957911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa908108d00 0x7fa90810b120 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009900 tx=0x7fa8f802a410 comp rx=0 tx=0).stop 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 -- 172.21.15.29:0/1769957911 shutdown_connections 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 --2- 172.21.15.29:0/1769957911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa90810b6b0 0x7fa90810dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 --2- 172.21.15.29:0/1769957911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa908108d00 0x7fa90810b120 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 --2- 172.21.15.29:0/1769957911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa90806c490 0x7fa9081087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 -- 172.21.15.29:0/1769957911 >> 172.21.15.29:0/1769957911 conn(0x7fa9080fdfe0 msgr2=0x7fa908100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:15.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 -- 172.21.15.29:0/1769957911 shutdown_connections 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 -- 172.21.15.29:0/1769957911 wait complete. 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 Processor -- start 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.408+0000 7fa90f794640 1 -- start start 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90f794640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa90806c490 0x7fa90819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90f794640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908108d00 0x7fa90819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90f794640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90810b6b0 0x7fa90819d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90f794640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa9081115c0 con 0x7fa90810b6b0 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90f794640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa908111440 con 0x7fa908108d00 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90f794640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa908111740 con 0x7fa90806c490 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90810b6b0 0x7fa90819d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90810b6b0 0x7fa90819d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44416/0 (socket says 172.21.15.29:44416) 2024-09-21T07:09:15.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 -- 172.21.15.29:0/743001381 learned_addr learned my addr 172.21.15.29:0/743001381 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90d530640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa90806c490 0x7fa90819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90cd2f640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908108d00 0x7fa90819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 -- 172.21.15.29:0/743001381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa90806c490 msgr2=0x7fa90819c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa90806c490 0x7fa90819c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 -- 172.21.15.29:0/743001381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908108d00 msgr2=0x7fa90819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908108d00 0x7fa90819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 -- 172.21.15.29:0/743001381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90819dc20 con 0x7fa90810b6b0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.409+0000 7fa90dd31640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90810b6b0 0x7fa90819d400 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa90000cad0 tx=0x7fa90000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.410+0000 7fa8fe7fc640 1 -- 172.21.15.29:0/743001381 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90000ae20 con 0x7fa90810b6b0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.410+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90819df10 con 0x7fa90810b6b0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.410+0000 7fa8fe7fc640 1 -- 172.21.15.29:0/743001381 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa900005020 con 0x7fa90810b6b0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.410+0000 7fa8fe7fc640 1 -- 172.21.15.29:0/743001381 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90000f6b0 con 0x7fa90810b6b0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.410+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9081a4610 con 0x7fa90810b6b0 2024-09-21T07:09:15.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.411+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9080ffb00 con 0x7fa90810b6b0 2024-09-21T07:09:15.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.412+0000 7fa8fe7fc640 1 -- 172.21.15.29:0/743001381 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa9000051d0 con 0x7fa90810b6b0 2024-09-21T07:09:15.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.413+0000 7fa8fe7fc640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa8f40b6510 0x7fa8f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:15.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.413+0000 7fa90d530640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa8f40b6510 0x7fa8f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:15.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.413+0000 7fa8fe7fc640 1 -- 172.21.15.29:0/743001381 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fa9000e76a0 con 0x7fa90810b6b0 2024-09-21T07:09:15.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.414+0000 7fa90d530640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa8f40b6510 0x7fa8f40b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa90400bbe0 tx=0x7fa90400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:15.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.416+0000 7fa8fe7fc640 1 -- 172.21.15.29:0/743001381 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa900014030 con 0x7fa90810b6b0 2024-09-21T07:09:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:15 smithi052 ceph-mon[34308]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:15.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:15 smithi052 ceph-mon[34308]: pgmap v344: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:15.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.617+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa908063800 con 0x7fa8f40b6510 2024-09-21T07:09:15.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.623+0000 7fa8fe7fc640 1 -- 172.21.15.29:0/743001381 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa908063800 con 0x7fa8f40b6510 2024-09-21T07:09:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T07:09:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:mds.all 12/12 42s ago 2m smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi066=c;smithi066=f;smithi066=i;smithi066=l;count:12 2024-09-21T07:09:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:mgr 3/3 42s ago 8m smithi029=x;smithi052=y;smithi066=z;count:3 2024-09-21T07:09:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:mon 3/3 42s ago 8m smithi029:172.21.15.29=a;smithi052:172.21.15.52=b;smithi066:172.21.15.66=c;count:3 2024-09-21T07:09:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:osd 12 42s ago - 2024-09-21T07:09:15.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa8f40b6510 msgr2=0x7fa8f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa8f40b6510 0x7fa8f40b8a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa90400bbe0 tx=0x7fa90400b390 comp rx=0 tx=0).stop 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90810b6b0 msgr2=0x7fa90819d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90810b6b0 0x7fa90819d400 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa90000cad0 tx=0x7fa90000cf90 comp rx=0 tx=0).stop 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 shutdown_connections 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fa8f40b6510 0x7fa8f40b8a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa90810b6b0 0x7fa90819d400 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa908108d00 0x7fa90819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 --2- 172.21.15.29:0/743001381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa90806c490 0x7fa90819c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 >> 172.21.15.29:0/743001381 conn(0x7fa9080fdfe0 msgr2=0x7fa908109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 shutdown_connections 2024-09-21T07:09:15.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:15.625+0000 7fa90f794640 1 -- 172.21.15.29:0/743001381 wait complete. 2024-09-21T07:09:16.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:16 smithi029 ceph-mon[30983]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:16.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T07:09:16.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:16 smithi052 ceph-mon[34308]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:16.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:16 smithi066 ceph-mon[34793]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:16.669 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 -- 172.21.15.29:0/1582247584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684104080 msgr2=0x7f468410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 --2- 172.21.15.29:0/1582247584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684104080 0x7f468410aa20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f467c009ca0 tx=0x7f467c02a950 comp rx=0 tx=0).stop 2024-09-21T07:09:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 -- 172.21.15.29:0/1582247584 shutdown_connections 2024-09-21T07:09:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 --2- 172.21.15.29:0/1582247584 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684104080 0x7f468410aa20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 --2- 172.21.15.29:0/1582247584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841036e0 0x7f4684103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 --2- 172.21.15.29:0/1582247584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4684102650 0x7f4684102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 -- 172.21.15.29:0/1582247584 >> 172.21.15.29:0/1582247584 conn(0x7f46840fdfe0 msgr2=0x7f4684100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 -- 172.21.15.29:0/1582247584 shutdown_connections 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 -- 172.21.15.29:0/1582247584 wait complete. 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.170+0000 7f468b9da640 1 Processor -- start 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f468b9da640 1 -- start start 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f468b9da640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684102650 0x7f468406c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f468b9da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841036e0 0x7f46841a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f468b9da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4684104080 0x7f46841a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f468b9da640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f468410e2a0 con 0x7f4684102650 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f468b9da640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f468410e120 con 0x7f46841036e0 2024-09-21T07:09:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f468b9da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f468410e420 con 0x7f4684104080 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684102650 0x7f468406c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684102650 0x7f468406c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44428/0 (socket says 172.21.15.29:44428) 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 -- 172.21.15.29:0/4175953075 learned_addr learned my addr 172.21.15.29:0/4175953075 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689f77640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4684104080 0x7f46841a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4688f75640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841036e0 0x7f46841a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 -- 172.21.15.29:0/4175953075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4684104080 msgr2=0x7f46841a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4684104080 0x7f46841a3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 -- 172.21.15.29:0/4175953075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841036e0 msgr2=0x7f46841a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841036e0 0x7f46841a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 -- 172.21.15.29:0/4175953075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46841a3c40 con 0x7f4684102650 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.171+0000 7f4689776640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684102650 0x7f468406c2e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f468000ea20 tx=0x7f468000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.172+0000 7f467a7fc640 1 -- 172.21.15.29:0/4175953075 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468000cd80 con 0x7f4684102650 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.172+0000 7f467a7fc640 1 -- 172.21.15.29:0/4175953075 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46800054d0 con 0x7f4684102650 2024-09-21T07:09:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.172+0000 7f468b9da640 1 -- 172.21.15.29:0/4175953075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46841a3f30 con 0x7f4684102650 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.172+0000 7f467a7fc640 1 -- 172.21.15.29:0/4175953075 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680010430 con 0x7f4684102650 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.172+0000 7f468b9da640 1 -- 172.21.15.29:0/4175953075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46841a4380 con 0x7f4684102650 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.173+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4684063fc0 con 0x7f4684102650 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.174+0000 7f467a7fc640 1 -- 172.21.15.29:0/4175953075 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4680005020 con 0x7f4684102650 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.175+0000 7f467a7fc640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f46700b6510 0x7f46700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.175+0000 7f4688f75640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f46700b6510 0x7f46700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.175+0000 7f467a7fc640 1 -- 172.21.15.29:0/4175953075 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f46800e7880 con 0x7f4684102650 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.176+0000 7f4688f75640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f46700b6510 0x7f46700b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4674005fd0 tx=0x7f4674005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.179+0000 7f467a7fc640 1 -- 172.21.15.29:0/4175953075 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46800ae120 con 0x7f4684102650 2024-09-21T07:09:17.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:17 smithi029 ceph-mon[30983]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:17.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.376+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f46840641e0 con 0x7f46700b6510 2024-09-21T07:09:17.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.378+0000 7f467a7fc640 1 -- 172.21.15.29:0/4175953075 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f46840641e0 con 0x7f46700b6510 2024-09-21T07:09:17.379 INFO:teuthology.orchestra.run.smithi029.stdout:HOST ADDR LABELS STATUS 2024-09-21T07:09:17.379 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029 172.21.15.29 2024-09-21T07:09:17.379 INFO:teuthology.orchestra.run.smithi029.stdout:smithi052 172.21.15.52 2024-09-21T07:09:17.380 INFO:teuthology.orchestra.run.smithi029.stdout:smithi066 172.21.15.66 2024-09-21T07:09:17.380 INFO:teuthology.orchestra.run.smithi029.stdout:3 hosts in cluster 2024-09-21T07:09:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f46700b6510 msgr2=0x7f46700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f46700b6510 0x7f46700b8a20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4674005fd0 tx=0x7f4674005850 comp rx=0 tx=0).stop 2024-09-21T07:09:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684102650 msgr2=0x7f468406c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684102650 0x7f468406c2e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f468000ea20 tx=0x7f468000ee20 comp rx=0 tx=0).stop 2024-09-21T07:09:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 shutdown_connections 2024-09-21T07:09:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f46700b6510 0x7f46700b8a20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4684104080 0x7f46841a3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46841036e0 0x7f46841a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 --2- 172.21.15.29:0/4175953075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4684102650 0x7f468406c2e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 >> 172.21.15.29:0/4175953075 conn(0x7f46840fdfe0 msgr2=0x7f4684106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 shutdown_connections 2024-09-21T07:09:17.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:17.380+0000 7f466ffff640 1 -- 172.21.15.29:0/4175953075 wait complete. 2024-09-21T07:09:17.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:17 smithi052 ceph-mon[34308]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:17 smithi066 ceph-mon[34793]: pgmap v345: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:18 smithi029 ceph-mon[30983]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:18.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T07:09:18.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:18 smithi052 ceph-mon[34308]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:18.518 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:18.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:18 smithi066 ceph-mon[34793]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:19.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 -- 172.21.15.29:0/3920628191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c4109480 msgr2=0x7f63c410b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 --2- 172.21.15.29:0/3920628191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c4109480 0x7f63c410b990 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009ca0 tx=0x7f63bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 -- 172.21.15.29:0/3920628191 shutdown_connections 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 --2- 172.21.15.29:0/3920628191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c4109480 0x7f63c410b990 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 --2- 172.21.15.29:0/3920628191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c41068e0 0x7f63c4108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 --2- 172.21.15.29:0/3920628191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c406c660 0x7f63c41063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 -- 172.21.15.29:0/3920628191 >> 172.21.15.29:0/3920628191 conn(0x7f63c40fdfe0 msgr2=0x7f63c4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 -- 172.21.15.29:0/3920628191 shutdown_connections 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.013+0000 7f63cc59c640 1 -- 172.21.15.29:0/3920628191 wait complete. 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 Processor -- start 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 -- start start 2024-09-21T07:09:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c406c660 0x7f63c4199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c41068e0 0x7f63c419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c4109480 0x7f63c419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f63c410f3a0 con 0x7f63c41068e0 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f63c410f220 con 0x7f63c406c660 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cc59c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f63c410f520 con 0x7f63c4109480 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c41068e0 0x7f63c419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c41068e0 0x7f63c419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54406/0 (socket says 172.21.15.29:54406) 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 -- 172.21.15.29:0/2958803227 learned_addr learned my addr 172.21.15.29:0/2958803227 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63ca338640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c406c660 0x7f63c4199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63cab39640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c4109480 0x7f63c419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 -- 172.21.15.29:0/2958803227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c4109480 msgr2=0x7f63c419b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c4109480 0x7f63c419b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 -- 172.21.15.29:0/2958803227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c406c660 msgr2=0x7f63c4199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c406c660 0x7f63c4199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.014+0000 7f63c9b37640 1 -- 172.21.15.29:0/2958803227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c419b990 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.015+0000 7f63c9b37640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c41068e0 0x7f63c419a5d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c970 tx=0x7f63b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.015+0000 7f63bb7fe640 1 -- 172.21.15.29:0/2958803227 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4007bb0 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.015+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c419bc80 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.015+0000 7f63bb7fe640 1 -- 172.21.15.29:0/2958803227 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63b4007d50 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.015+0000 7f63bb7fe640 1 -- 172.21.15.29:0/2958803227 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b400f450 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.015+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c41a2380 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.016+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c40ffb00 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.018+0000 7f63bb7fe640 1 -- 172.21.15.29:0/2958803227 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f63b4004f20 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.019+0000 7f63bb7fe640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f63b00b6510 0x7f63b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.019+0000 7f63ca338640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f63b00b6510 0x7f63b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.019+0000 7f63bb7fe640 1 -- 172.21.15.29:0/2958803227 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f63b40e6ff0 con 0x7f63c41068e0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.019+0000 7f63ca338640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f63b00b6510 0x7f63b00b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f63c000bbe0 tx=0x7f63c000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.023+0000 7f63bb7fe640 1 -- 172.21.15.29:0/2958803227 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63b4014030 con 0x7f63c41068e0 2024-09-21T07:09:19.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.220+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 --> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f63c4063800 con 0x7f63b00b6510 2024-09-21T07:09:19.222 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:19 smithi029 ceph-mon[30983]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.221+0000 7f63bb7fe640 1 -- 172.21.15.29:0/2958803227 <== mgr.14152 v2:172.21.15.29:6800/4201921978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f63c4063800 con 0x7f63b00b6510 2024-09-21T07:09:19.223 INFO:teuthology.orchestra.run.smithi029.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T07:09:19.223 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009B480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:09:19.223 INFO:teuthology.orchestra.run.smithi029.stdout:smithi052 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513010N480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T07:09:19.223 INFO:teuthology.orchestra.run.smithi029.stdout:smithi066 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53430091400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T07:09:19.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f63b00b6510 msgr2=0x7f63b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:19.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f63b00b6510 0x7f63b00b8a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f63c000bbe0 tx=0x7f63c000b390 comp rx=0 tx=0).stop 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c41068e0 msgr2=0x7f63c419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c41068e0 0x7f63c419a5d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c970 tx=0x7f63b400ce30 comp rx=0 tx=0).stop 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 shutdown_connections 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f63b00b6510 0x7f63b00b8a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63c4109480 0x7f63c419b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63c41068e0 0x7f63c419a5d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 --2- 172.21.15.29:0/2958803227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63c406c660 0x7f63c4199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 >> 172.21.15.29:0/2958803227 conn(0x7f63c40fdfe0 msgr2=0x7f63c4104d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 shutdown_connections 2024-09-21T07:09:19.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:19.224+0000 7f63cc59c640 1 -- 172.21.15.29:0/2958803227 wait complete. 2024-09-21T07:09:19.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:19 smithi052 ceph-mon[34308]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:19 smithi066 ceph-mon[34793]: pgmap v346: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:20.086 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T07:09:20.095 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T07:09:20.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T07:09:20.363 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:20.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:20 smithi029 ceph-mon[30983]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:20.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:20 smithi052 ceph-mon[34308]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:20.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:20 smithi066 ceph-mon[34793]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T07:09:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.873+0000 7fc0bdecb640 1 -- 172.21.15.29:0/2463310014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8104080 msgr2=0x7fc0b810aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.873+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/2463310014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8104080 0x7fc0b810aa20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009ca0 tx=0x7fc0b002a950 comp rx=0 tx=0).stop 2024-09-21T07:09:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 -- 172.21.15.29:0/2463310014 shutdown_connections 2024-09-21T07:09:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/2463310014 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8104080 0x7fc0b810aa20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/2463310014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0b81036e0 0x7fc0b8103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/2463310014 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b8102650 0x7fc0b8102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 -- 172.21.15.29:0/2463310014 >> 172.21.15.29:0/2463310014 conn(0x7fc0b80fdfe0 msgr2=0x7fc0b8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 -- 172.21.15.29:0/2463310014 shutdown_connections 2024-09-21T07:09:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 -- 172.21.15.29:0/2463310014 wait complete. 2024-09-21T07:09:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 Processor -- start 2024-09-21T07:09:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.874+0000 7fc0bdecb640 1 -- start start 2024-09-21T07:09:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0bdecb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8102650 0x7fc0b8199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0bdecb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0b81036e0 0x7fc0b819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0bdecb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b8104080 0x7fc0b819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0bdecb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b810e280 con 0x7fc0b8102650 2024-09-21T07:09:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0bdecb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b810e100 con 0x7fc0b8104080 2024-09-21T07:09:20.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0bdecb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b810e400 con 0x7fc0b81036e0 2024-09-21T07:09:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8102650 0x7fc0b8199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8102650 0x7fc0b8199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54428/0 (socket says 172.21.15.29:54428) 2024-09-21T07:09:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 -- 172.21.15.29:0/3233003472 learned_addr learned my addr 172.21.15.29:0/3233003472 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b6ffd640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0b81036e0 0x7fc0b819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b7fff640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b8104080 0x7fc0b819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 -- 172.21.15.29:0/3233003472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0b81036e0 msgr2=0x7fc0b819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0b81036e0 0x7fc0b819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 -- 172.21.15.29:0/3233003472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b8104080 msgr2=0x7fc0b819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b8104080 0x7fc0b819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 -- 172.21.15.29:0/3233003472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b819b990 con 0x7fc0b8102650 2024-09-21T07:09:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.875+0000 7fc0b77fe640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8102650 0x7fc0b8199f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e9f0 tx=0x7fc0a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.876+0000 7fc0b4ff9640 1 -- 172.21.15.29:0/3233003472 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800cd80 con 0x7fc0b8102650 2024-09-21T07:09:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.876+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b819bc80 con 0x7fc0b8102650 2024-09-21T07:09:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.876+0000 7fc0b4ff9640 1 -- 172.21.15.29:0/3233003472 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0a80108e0 con 0x7fc0b8102650 2024-09-21T07:09:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.876+0000 7fc0b4ff9640 1 -- 172.21.15.29:0/3233003472 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8018980 con 0x7fc0b8102650 2024-09-21T07:09:20.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.876+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b81a2380 con 0x7fc0b8102650 2024-09-21T07:09:20.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.877+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b81a2550 con 0x7fc0b8102650 2024-09-21T07:09:20.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.879+0000 7fc0b4ff9640 1 -- 172.21.15.29:0/3233003472 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc0a8010430 con 0x7fc0b8102650 2024-09-21T07:09:20.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.880+0000 7fc0b4ff9640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0a00b6510 0x7fc0a00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:20.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.880+0000 7fc0b6ffd640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0a00b6510 0x7fc0a00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.880+0000 7fc0b4ff9640 1 -- 172.21.15.29:0/3233003472 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc0a80e7b40 con 0x7fc0b8102650 2024-09-21T07:09:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.880+0000 7fc0b6ffd640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0a00b6510 0x7fc0a00b8a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac005d00 tx=0x7fc0ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:20.883+0000 7fc0b4ff9640 1 -- 172.21.15.29:0/3233003472 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0a80ae3e0 con 0x7fc0b8102650 2024-09-21T07:09:21.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.111+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc0b81a2720 con 0x7fc0b8102650 2024-09-21T07:09:21.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.112+0000 7fc0b4ff9640 1 -- 172.21.15.29:0/3233003472 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3118 (secure 0 0 0) 0x7fc0a80b27c0 con 0x7fc0b8102650 2024-09-21T07:09:21.113 INFO:teuthology.orchestra.run.smithi029.stdout:e27 2024-09-21T07:09:21.113 INFO:teuthology.orchestra.run.smithi029.stdout:btime 2024-09-21T07:07:44:626522+0000 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 27 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-09-21T07:07:33.244548+0000 2024-09-21T07:09:21.114 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2024-09-21T07:07:44.626498+0000 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 300 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 5 2024-09-21T07:09:21.115 INFO:teuthology.orchestra.run.smithi029.stdout:in 0,1,2,3,4 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=24692,1=24655,2=24653,3=24640,4=24629} 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3] 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 0 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:qdb_cluster leader: 24692 members: 24692,24653,24640,24655,24629 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b{0:24692} state up:active seq 4 addr [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.f{0:24628} state up:standby-replay seq 1 addr [v2:172.21.15.66:6834/1200693038,v1:172.21.15.66:6835/1200693038] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.i{1:24655} state up:active seq 8 addr [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.116 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.k{1:24599} state up:standby-replay seq 1 addr [v2:172.21.15.52:6832/2941334623,v1:172.21.15.52:6833/2941334623] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.h{2:24653} state up:active seq 9 addr [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.l{2:24595} state up:standby-replay seq 1 addr [v2:172.21.15.66:6832/3104127935,v1:172.21.15.66:6833/3104127935] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c{3:24640} state up:active seq 10 addr [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a{3:14826} state up:standby-replay seq 1 addr [v2:172.21.15.29:6840/659023126,v1:172.21.15.29:6841/659023126] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.e{4:24629} state up:active seq 11 addr [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.g{4:14814} state up:standby-replay seq 1 addr [v2:172.21.15.29:6838/3672589136,v1:172.21.15.29:6839/3672589136] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2024-09-21T07:09:21.117 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:21.118 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.j{-1:14751} state up:standby seq 1 addr [v2:172.21.15.29:6834/3753140533,v1:172.21.15.29:6835/3753140533] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.118 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d{-1:14763} state up:standby seq 1 addr [v2:172.21.15.29:6836/528626993,v1:172.21.15.29:6837/528626993] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T07:09:21.118 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0a00b6510 msgr2=0x7fc0a00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0a00b6510 0x7fc0a00b8a20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac005d00 tx=0x7fc0ac00b410 comp rx=0 tx=0).stop 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8102650 msgr2=0x7fc0b8199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8102650 0x7fc0b8199f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e9f0 tx=0x7fc0a800eeb0 comp rx=0 tx=0).stop 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 shutdown_connections 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc0a00b6510 0x7fc0a00b8a20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b8104080 0x7fc0b819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:21.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0b81036e0 0x7fc0b819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:21.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 --2- 172.21.15.29:0/3233003472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc0b8102650 0x7fc0b8199f60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:21.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 >> 172.21.15.29:0/3233003472 conn(0x7fc0b80fdfe0 msgr2=0x7fc0b80ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:21.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 shutdown_connections 2024-09-21T07:09:21.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:21.115+0000 7fc0bdecb640 1 -- 172.21.15.29:0/3233003472 wait complete. 2024-09-21T07:09:21.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:21 smithi029 ceph-mon[30983]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:21.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:21 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3233003472' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:09:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:21 smithi052 ceph-mon[34308]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:21.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:21 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3233003472' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:09:21.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:21 smithi066 ceph-mon[34793]: pgmap v347: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:21.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:21 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3233003472' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T07:09:21.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T07:09:22.198 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 -- 172.21.15.29:0/3991337123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c74104800 msgr2=0x7f1c74104c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 --2- 172.21.15.29:0/3991337123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c74104800 0x7f1c74104c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009900 tx=0x7f1c6802a480 comp rx=0 tx=0).stop 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 -- 172.21.15.29:0/3991337123 shutdown_connections 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 --2- 172.21.15.29:0/3991337123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c741051a0 0x7f1c7410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 --2- 172.21.15.29:0/3991337123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c74104800 0x7f1c74104c10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 --2- 172.21.15.29:0/3991337123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c74103770 0x7f1c74103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 -- 172.21.15.29:0/3991337123 >> 172.21.15.29:0/3991337123 conn(0x7f1c740ff0c0 msgr2=0x7f1c74101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 -- 172.21.15.29:0/3991337123 shutdown_connections 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.753+0000 7f1c790cf640 1 -- 172.21.15.29:0/3991337123 wait complete. 2024-09-21T07:09:22.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 Processor -- start 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 -- start start 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c74103770 0x7f1c74199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c74104800 0x7f1c7419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c741051a0 0x7f1c7419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410f3a0 con 0x7f1c741051a0 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410f220 con 0x7f1c74103770 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c790cf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7410f520 con 0x7f1c74104800 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c7359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c741051a0 0x7f1c7419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c7359e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c741051a0 0x7f1c7419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54450/0 (socket says 172.21.15.29:54450) 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c7359e640 1 -- 172.21.15.29:0/1125656621 learned_addr learned my addr 172.21.15.29:0/1125656621 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c7259c640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c74104800 0x7f1c7419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.754+0000 7f1c72d9d640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c74103770 0x7f1c74199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c7359e640 1 -- 172.21.15.29:0/1125656621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c74104800 msgr2=0x7f1c7419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:22.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c7359e640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c74104800 0x7f1c7419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c7359e640 1 -- 172.21.15.29:0/1125656621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c74103770 msgr2=0x7f1c74199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c7359e640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c74103770 0x7f1c74199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c7359e640 1 -- 172.21.15.29:0/1125656621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7419b9c0 con 0x7f1c741051a0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c72d9d640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c74103770 0x7f1c74199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c7359e640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c741051a0 0x7f1c7419b1a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00eaa0 tx=0x7f1c6c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c5bfff640 1 -- 172.21.15.29:0/1125656621 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c00cdb0 con 0x7f1c741051a0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7419bcb0 con 0x7f1c741051a0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c5bfff640 1 -- 172.21.15.29:0/1125656621 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c6c005020 con 0x7f1c741051a0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c5bfff640 1 -- 172.21.15.29:0/1125656621 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0116d0 con 0x7f1c741051a0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.755+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c741a23b0 con 0x7f1c741051a0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.756+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7410a950 con 0x7f1c741051a0 2024-09-21T07:09:22.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.758+0000 7f1c5bfff640 1 -- 172.21.15.29:0/1125656621 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1c6c0051d0 con 0x7f1c741051a0 2024-09-21T07:09:22.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.759+0000 7f1c5bfff640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1c5c0b6510 0x7f1c5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:22.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.760+0000 7f1c72d9d640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1c5c0b6510 0x7f1c5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:22.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.760+0000 7f1c5bfff640 1 -- 172.21.15.29:0/1125656621 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f1c6c0e7890 con 0x7f1c741051a0 2024-09-21T07:09:22.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.760+0000 7f1c72d9d640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1c5c0b6510 0x7f1c5c0b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005d00 tx=0x7f1c64005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:22.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.762+0000 7f1c5bfff640 1 -- 172.21.15.29:0/1125656621 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c6c016030 con 0x7f1c741051a0 2024-09-21T07:09:22.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.952+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f1c74063fc0 con 0x7f1c741051a0 2024-09-21T07:09:22.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.953+0000 7f1c5bfff640 1 -- 172.21.15.29:0/1125656621 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5255 (secure 0 0 0) 0x7f1c6c0ae130 con 0x7f1c741051a0 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 75 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-09-21T06:59:06.543850+0000 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2024-09-21T07:07:57.657853+0000 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:crush_version 26 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:full_ratio 0.95 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:backfillfull_ratio 0.9 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:nearfull_ratio 0.85 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:require_min_compat_client luminous 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:min_compat_client luminous 2024-09-21T07:09:22.956 INFO:teuthology.orchestra.run.smithi029.stdout:require_osd_release squid 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:stretch_mode_enabled false 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:max_osd 12 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 up in weight 1 up_from 8 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6802/2373940457,v1:172.21.15.29:6803/2373940457] [v2:172.21.15.29:6804/2373940457,v1:172.21.15.29:6805/2373940457] exists,up 7e7c8389-ee51-4f2c-802c-d0b9be785e91 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 up in weight 1 up_from 13 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6800/1978715722,v1:172.21.15.52:6801/1978715722] [v2:172.21.15.52:6802/1978715722,v1:172.21.15.52:6803/1978715722] exists,up 5beaa28d-3076-4361-8a0a-026ee6e24cd2 2024-09-21T07:09:22.957 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 up in weight 1 up_from 18 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6800/318756660,v1:172.21.15.66:6801/318756660] [v2:172.21.15.66:6802/318756660,v1:172.21.15.66:6803/318756660] exists,up f3e766f0-ba27-44b6-88b9-fb512a6b34cb 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 up in weight 1 up_from 24 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6810/3285297772,v1:172.21.15.29:6811/3285297772] [v2:172.21.15.29:6812/3285297772,v1:172.21.15.29:6813/3285297772] exists,up d9d78e06-efec-4508-bfdd-eb451ce9f219 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 up in weight 1 up_from 30 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6808/189683591,v1:172.21.15.52:6809/189683591] [v2:172.21.15.52:6810/189683591,v1:172.21.15.52:6811/189683591] exists,up dde7a9d8-18ea-4717-85b7-d747f1bd620c 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 up in weight 1 up_from 34 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6808/3149868590,v1:172.21.15.66:6809/3149868590] [v2:172.21.15.66:6810/3149868590,v1:172.21.15.66:6811/3149868590] exists,up d329891b-ec44-4ca8-bc4b-a770ba76ea24 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 up in weight 1 up_from 40 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6818/3038729725,v1:172.21.15.29:6819/3038729725] [v2:172.21.15.29:6820/3038729725,v1:172.21.15.29:6821/3038729725] exists,up 69cab741-228d-4d88-80e0-a871ae498271 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 up in weight 1 up_from 45 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6816/4067251695,v1:172.21.15.52:6817/4067251695] [v2:172.21.15.52:6818/4067251695,v1:172.21.15.52:6819/4067251695] exists,up 54a8f327-cf53-4753-8b91-a19aa92fd237 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.8 up in weight 1 up_from 51 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6816/1991639723,v1:172.21.15.66:6817/1991639723] [v2:172.21.15.66:6818/1991639723,v1:172.21.15.66:6819/1991639723] exists,up 5542b251-2218-4751-bee7-006dfa5ce8e8 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.9 up in weight 1 up_from 57 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6826/2032308590,v1:172.21.15.29:6827/2032308590] [v2:172.21.15.29:6828/2032308590,v1:172.21.15.29:6829/2032308590] exists,up 2be711e7-2f39-4acb-bb4b-c8cbfdfa9909 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.10 up in weight 1 up_from 62 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6824/1774195182,v1:172.21.15.52:6825/1774195182] [v2:172.21.15.52:6826/1774195182,v1:172.21.15.52:6827/1774195182] exists,up fe637203-8937-4364-b1d8-010c5f1f238c 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:osd.11 up in weight 1 up_from 67 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6824/3573709450,v1:172.21.15.66:6825/3573709450] [v2:172.21.15.66:6826/3573709450,v1:172.21.15.66:6827/3573709450] exists,up 7c6b8370-2b17-447f-b315-c7c04fb51288 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.a [2,11] 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.f [8,11] 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.1a [8,1] 2024-09-21T07:09:22.958 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 3.1b [5,9] 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 3.1d [4,8] 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 3.24 [4,9] 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 3.2c [4,9] 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/726985884 expires 2024-09-22T06:59:55.886513+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6800/1750085981 expires 2024-09-22T06:59:55.886513+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/3835788176 expires 2024-09-22T06:59:55.886513+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6801/1750085981 expires 2024-09-22T06:59:55.886513+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/3563710516 expires 2024-09-22T06:59:55.886513+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/3612028397 expires 2024-09-22T06:59:29.378609+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/3737682661 expires 2024-09-22T06:59:29.378609+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6801/675419935 expires 2024-09-22T06:59:29.378609+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/1507156797 expires 2024-09-22T06:59:29.378609+0000 2024-09-21T07:09:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6800/675419935 expires 2024-09-22T06:59:29.378609+0000 2024-09-21T07:09:22.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1c5c0b6510 msgr2=0x7f1c5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:22.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1c5c0b6510 0x7f1c5c0b8a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005d00 tx=0x7f1c64005c70 comp rx=0 tx=0).stop 2024-09-21T07:09:22.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c741051a0 msgr2=0x7f1c7419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:22.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c741051a0 0x7f1c7419b1a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00eaa0 tx=0x7f1c6c00ef60 comp rx=0 tx=0).stop 2024-09-21T07:09:22.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 shutdown_connections 2024-09-21T07:09:22.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f1c5c0b6510 0x7f1c5c0b8a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c741051a0 0x7f1c7419b1a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c74104800 0x7f1c7419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 --2- 172.21.15.29:0/1125656621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c74103770 0x7f1c74199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:22.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 >> 172.21.15.29:0/1125656621 conn(0x7f1c740ff0c0 msgr2=0x7f1c74107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:22.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 shutdown_connections 2024-09-21T07:09:22.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:22.956+0000 7f1c790cf640 1 -- 172.21.15.29:0/1125656621 wait complete. 2024-09-21T07:09:23.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:23 smithi052 ceph-mon[34308]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:23.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:23 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1125656621' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:09:23.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:23 smithi066 ceph-mon[34793]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:23.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:23 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1125656621' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:09:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:23 smithi029 ceph-mon[30983]: pgmap v348: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:23 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1125656621' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T07:09:23.797 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T07:09:23.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:09:24.080 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:24.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 -- 172.21.15.29:0/3135755445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c1094a0 msgr2=0x7f206c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 --2- 172.21.15.29:0/3135755445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c1094a0 0x7f206c1098b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2054009900 tx=0x7f205402a410 comp rx=0 tx=0).stop 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 -- 172.21.15.29:0/3135755445 shutdown_connections 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 --2- 172.21.15.29:0/3135755445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f206c109df0 0x7f206c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 --2- 172.21.15.29:0/3135755445 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c1094a0 0x7f206c1098b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 --2- 172.21.15.29:0/3135755445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c103b60 0x7f206c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 -- 172.21.15.29:0/3135755445 >> 172.21.15.29:0/3135755445 conn(0x7f206c07b850 msgr2=0x7f206c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 -- 172.21.15.29:0/3135755445 shutdown_connections 2024-09-21T07:09:24.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.591+0000 7f2070f5a640 1 -- 172.21.15.29:0/3135755445 wait complete. 2024-09-21T07:09:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 Processor -- start 2024-09-21T07:09:24.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 -- start start 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c103b60 0x7f206c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f206c1094a0 0x7f206c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c109df0 0x7f206c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f206c113ab0 con 0x7f206c103b60 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f206c113930 con 0x7f206c109df0 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2070f5a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f206c113c30 con 0x7f206c1094a0 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f206a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c103b60 0x7f206c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f206a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c103b60 0x7f206c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54458/0 (socket says 172.21.15.29:54458) 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f206a59c640 1 -- 172.21.15.29:0/2741887649 learned_addr learned my addr 172.21.15.29:0/2741887649 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f206ad9d640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c109df0 0x7f206c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.592+0000 7f2069d9b640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f206c1094a0 0x7f206c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f206a59c640 1 -- 172.21.15.29:0/2741887649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f206c1094a0 msgr2=0x7f206c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:24.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f206a59c640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f206c1094a0 0x7f206c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f206a59c640 1 -- 172.21.15.29:0/2741887649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c109df0 msgr2=0x7f206c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f206a59c640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c109df0 0x7f206c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f206a59c640 1 -- 172.21.15.29:0/2741887649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c1a8840 con 0x7f206c103b60 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f206a59c640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c103b60 0x7f206c075710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f205c00d950 tx=0x7f205c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f20637fe640 1 -- 172.21.15.29:0/2741887649 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c017070 con 0x7f206c103b60 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f20637fe640 1 -- 172.21.15.29:0/2741887649 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c009c30 con 0x7f206c103b60 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206c1a8b30 con 0x7f206c103b60 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f20637fe640 1 -- 172.21.15.29:0/2741887649 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c00f620 con 0x7f206c103b60 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.593+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206c1a9090 con 0x7f206c103b60 2024-09-21T07:09:24.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.594+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206c103f70 con 0x7f206c103b60 2024-09-21T07:09:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.596+0000 7f20637fe640 1 -- 172.21.15.29:0/2741887649 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f205c005030 con 0x7f206c103b60 2024-09-21T07:09:24.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.597+0000 7f20637fe640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f20580b6590 0x7f20580b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.597+0000 7f2069d9b640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f20580b6590 0x7f20580b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.597+0000 7f20637fe640 1 -- 172.21.15.29:0/2741887649 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f205c0e6d90 con 0x7f206c103b60 2024-09-21T07:09:24.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.597+0000 7f2069d9b640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f20580b6590 0x7f20580b8aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2054009230 tx=0x7f2054031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:24.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.600+0000 7f20637fe640 1 -- 172.21.15.29:0/2741887649 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f205c009de0 con 0x7f206c103b60 2024-09-21T07:09:24.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.826+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f206c10bbc0 con 0x7f206c103b60 2024-09-21T07:09:24.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.827+0000 7f20637fe640 1 -- 172.21.15.29:0/2741887649 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11958 (secure 0 0 0) 0x7f205c0b1a90 con 0x7f206c103b60 2024-09-21T07:09:24.828 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:24.829 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2024-09-21T07:09:24.829 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"btime":"2024-09-21T07:07:44:626522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:07:44.626498+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f20580b6590 msgr2=0x7f20580b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f20580b6590 0x7f20580b8aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2054009230 tx=0x7f2054031400 comp rx=0 tx=0).stop 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c103b60 msgr2=0x7f206c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c103b60 0x7f206c075710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f205c00d950 tx=0x7f205c00de10 comp rx=0 tx=0).stop 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 shutdown_connections 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f20580b6590 0x7f20580b8aa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f206c109df0 0x7f206c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f206c1094a0 0x7f206c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 --2- 172.21.15.29:0/2741887649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f206c103b60 0x7f206c075710 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 >> 172.21.15.29:0/2741887649 conn(0x7f206c07b850 msgr2=0x7f206c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 shutdown_connections 2024-09-21T07:09:24.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:24.829+0000 7f2070f5a640 1 -- 172.21.15.29:0/2741887649 wait complete. 2024-09-21T07:09:25.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:25 smithi052 ceph-mon[34308]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:25.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:25 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2741887649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:25.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:25 smithi066 ceph-mon[34793]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:25.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:25 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2741887649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:25 smithi029 ceph-mon[30983]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:25 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2741887649' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:25.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:09:25.996 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 -- 172.21.15.29:0/3335920511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c109df0 msgr2=0x7f9c5c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3335920511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c109df0 0x7f9c5c110620 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009ca0 tx=0x7f9c5402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 -- 172.21.15.29:0/3335920511 shutdown_connections 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3335920511 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c109df0 0x7f9c5c110620 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3335920511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c5c1094a0 0x7f9c5c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3335920511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c5c103b60 0x7f9c5c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 -- 172.21.15.29:0/3335920511 >> 172.21.15.29:0/3335920511 conn(0x7f9c5c07b850 msgr2=0x7f9c5c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 -- 172.21.15.29:0/3335920511 shutdown_connections 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.515+0000 7f9c6220d640 1 -- 172.21.15.29:0/3335920511 wait complete. 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.516+0000 7f9c6220d640 1 Processor -- start 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.516+0000 7f9c6220d640 1 -- start start 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.516+0000 7f9c6220d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c5c103b60 0x7f9c5c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.516+0000 7f9c6220d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c1094a0 0x7f9c5c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.516+0000 7f9c6220d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c5c109df0 0x7f9c5c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c6220d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c113ab0 con 0x7f9c5c1094a0 2024-09-21T07:09:26.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c6220d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c113930 con 0x7f9c5c103b60 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c6220d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c113c30 con 0x7f9c5c109df0 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c1094a0 0x7f9c5c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c1094a0 0x7f9c5c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:54462/0 (socket says 172.21.15.29:54462) 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c5c103b60 0x7f9c5c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 -- 172.21.15.29:0/3143724983 learned_addr learned my addr 172.21.15.29:0/3143724983 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5bfff640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c5c109df0 0x7f9c5c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 -- 172.21.15.29:0/3143724983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c5c109df0 msgr2=0x7f9c5c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c5c109df0 0x7f9c5c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 -- 172.21.15.29:0/3143724983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c5c103b60 msgr2=0x7f9c5c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c5c103b60 0x7f9c5c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 -- 172.21.15.29:0/3143724983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5c1a02f0 con 0x7f9c5c1094a0 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5bfff640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c5c109df0 0x7f9c5c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:26.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c5affd640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c1094a0 0x7f9c5c19a9e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c8c0 tx=0x7f9c4400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:26.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c58ff9640 1 -- 172.21.15.29:0/3143724983 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44007bb0 con 0x7f9c5c1094a0 2024-09-21T07:09:26.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5c1a05e0 con 0x7f9c5c1094a0 2024-09-21T07:09:26.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c58ff9640 1 -- 172.21.15.29:0/3143724983 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c44007d50 con 0x7f9c5c1094a0 2024-09-21T07:09:26.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.517+0000 7f9c58ff9640 1 -- 172.21.15.29:0/3143724983 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c440187c0 con 0x7f9c5c1094a0 2024-09-21T07:09:26.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.518+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5c1a6e00 con 0x7f9c5c1094a0 2024-09-21T07:09:26.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.518+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c5c103f70 con 0x7f9c5c1094a0 2024-09-21T07:09:26.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.520+0000 7f9c58ff9640 1 -- 172.21.15.29:0/3143724983 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9c4400fa20 con 0x7f9c5c1094a0 2024-09-21T07:09:26.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.521+0000 7f9c58ff9640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f9c480b6540 0x7f9c480b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:26.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.521+0000 7f9c58ff9640 1 -- 172.21.15.29:0/3143724983 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f9c440e7620 con 0x7f9c5c1094a0 2024-09-21T07:09:26.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.521+0000 7f9c5b7fe640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f9c480b6540 0x7f9c480b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:26.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.522+0000 7f9c5b7fe640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f9c480b6540 0x7f9c480b8a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00bbe0 tx=0x7f9c4c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:26.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.524+0000 7f9c58ff9640 1 -- 172.21.15.29:0/3143724983 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c44014030 con 0x7f9c5c1094a0 2024-09-21T07:09:26.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.762+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c5c19b570 con 0x7f9c5c1094a0 2024-09-21T07:09:26.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.762+0000 7f9c58ff9640 1 -- 172.21.15.29:0/3143724983 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11958 (secure 0 0 0) 0x7f9c440adf50 con 0x7f9c5c1094a0 2024-09-21T07:09:26.764 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:26.765 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":27,"btime":"2024-09-21T07:07:44:626522+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:07:44.626498+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:09:26.765 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 27 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f9c480b6540 msgr2=0x7f9c480b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f9c480b6540 0x7f9c480b8a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00bbe0 tx=0x7f9c4c00b390 comp rx=0 tx=0).stop 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c1094a0 msgr2=0x7f9c5c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c1094a0 0x7f9c5c19a9e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c8c0 tx=0x7f9c4400cd80 comp rx=0 tx=0).stop 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 shutdown_connections 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f9c480b6540 0x7f9c480b8a50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c5c109df0 0x7f9c5c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c5c1094a0 0x7f9c5c19a9e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 --2- 172.21.15.29:0/3143724983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c5c103b60 0x7f9c5c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:26.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 >> 172.21.15.29:0/3143724983 conn(0x7f9c5c07b850 msgr2=0x7f9c5c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:26.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 shutdown_connections 2024-09-21T07:09:26.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:26.765+0000 7f9c6220d640 1 -- 172.21.15.29:0/3143724983 wait complete. 2024-09-21T07:09:27.492 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:27 smithi052 ceph-mon[34308]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:27.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:27 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3143724983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:27.532 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:27 smithi029 ceph-mon[30983]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:27.532 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:27 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3143724983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:27.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:09:27.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:27 smithi066 ceph-mon[34793]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:27.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:27 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3143724983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:09:27.832 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:28.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.363+0000 7ff905390640 1 -- 172.21.15.29:0/4017496025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff900109df0 msgr2=0x7ff900110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:28.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.363+0000 7ff905390640 1 --2- 172.21.15.29:0/4017496025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff900109df0 0x7ff900110620 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009ca0 tx=0x7ff8f802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.363+0000 7ff905390640 1 -- 172.21.15.29:0/4017496025 shutdown_connections 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.363+0000 7ff905390640 1 --2- 172.21.15.29:0/4017496025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff900109df0 0x7ff900110620 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.363+0000 7ff905390640 1 --2- 172.21.15.29:0/4017496025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9001094a0 0x7ff9001098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.363+0000 7ff905390640 1 --2- 172.21.15.29:0/4017496025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900103b60 0x7ff900103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.363+0000 7ff905390640 1 -- 172.21.15.29:0/4017496025 >> 172.21.15.29:0/4017496025 conn(0x7ff90007b850 msgr2=0x7ff90007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.364+0000 7ff905390640 1 -- 172.21.15.29:0/4017496025 shutdown_connections 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.364+0000 7ff905390640 1 -- 172.21.15.29:0/4017496025 wait complete. 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.364+0000 7ff905390640 1 Processor -- start 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.364+0000 7ff905390640 1 -- start start 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff905390640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff900103b60 0x7ff90019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff905390640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9001094a0 0x7ff90019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:28.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff905390640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900109df0 0x7ff90019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff905390640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff900113ab0 con 0x7ff9001094a0 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff905390640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff900113930 con 0x7ff900103b60 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff905390640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff900113c30 con 0x7ff900109df0 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9001094a0 0x7ff90019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9001094a0 0x7ff90019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33854/0 (socket says 172.21.15.29:33854) 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 -- 172.21.15.29:0/1833432063 learned_addr learned my addr 172.21.15.29:0/1833432063 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8ff7fe640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900109df0 0x7ff90019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8feffd640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff900103b60 0x7ff90019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 -- 172.21.15.29:0/1833432063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900109df0 msgr2=0x7ff90019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900109df0 0x7ff90019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 -- 172.21.15.29:0/1833432063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff900103b60 msgr2=0x7ff90019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff900103b60 0x7ff90019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 -- 172.21.15.29:0/1833432063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9001a03b0 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.365+0000 7ff8f67fc640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9001094a0 0x7ff90019a9e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c970 tx=0x7ff8e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.366+0000 7ff8fcff9640 1 -- 172.21.15.29:0/1833432063 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8007bb0 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.366+0000 7ff8fcff9640 1 -- 172.21.15.29:0/1833432063 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8e8007d50 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.366+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9001a06a0 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.366+0000 7ff8fcff9640 1 -- 172.21.15.29:0/1833432063 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8004e10 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.366+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9001a6e00 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.367+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff900103f70 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.368+0000 7ff8fcff9640 1 -- 172.21.15.29:0/1833432063 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff8e8005000 con 0x7ff9001094a0 2024-09-21T07:09:28.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.369+0000 7ff8fcff9640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8ec0b6510 0x7ff8ec0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.369+0000 7ff8fcff9640 1 -- 172.21.15.29:0/1833432063 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7ff8e80e7420 con 0x7ff9001094a0 2024-09-21T07:09:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.369+0000 7ff8feffd640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8ec0b6510 0x7ff8ec0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.370+0000 7ff8feffd640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8ec0b6510 0x7ff8ec0b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0005fd0 tx=0x7ff8f0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:28.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.372+0000 7ff8fcff9640 1 -- 172.21.15.29:0/1833432063 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8e8014030 con 0x7ff9001094a0 2024-09-21T07:09:28.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.559+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff90019b570 con 0x7ff9001094a0 2024-09-21T07:09:28.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.561+0000 7ff8fcff9640 1 -- 172.21.15.29:0/1833432063 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22640 (secure 0 0 0) 0x7ff90019b570 con 0x7ff9001094a0 2024-09-21T07:09:28.563 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:09:28.563 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":75,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:57.657853+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8ec0b6510 msgr2=0x7ff8ec0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8ec0b6510 0x7ff8ec0b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0005fd0 tx=0x7ff8f0005850 comp rx=0 tx=0).stop 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9001094a0 msgr2=0x7ff90019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9001094a0 0x7ff90019a9e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c970 tx=0x7ff8e800ce30 comp rx=0 tx=0).stop 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 shutdown_connections 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7ff8ec0b6510 0x7ff8ec0b8a20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff900109df0 0x7ff90019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff9001094a0 0x7ff90019a9e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 --2- 172.21.15.29:0/1833432063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff900103b60 0x7ff90019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:28.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 >> 172.21.15.29:0/1833432063 conn(0x7ff90007b850 msgr2=0x7ff900105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 shutdown_connections 2024-09-21T07:09:28.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:28.564+0000 7ff905390640 1 -- 172.21.15.29:0/1833432063 wait complete. 2024-09-21T07:09:29.410 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:29 smithi029 ceph-mon[30983]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:29.410 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:29 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1833432063' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:29.444 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T07:07:33.244548+0000', 'modified': '2024-09-21T07:07:44.626498+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24692, 'mds_1': 24655, 'mds_2': 24653, 'mds_3': 24640, 'mds_4': 24629}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14814': {'gid': 14814, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.29:6839/3672589136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6838', 'nonce': 3672589136}, {'type': 'v1', 'addr': '172.21.15.29:6839', 'nonce': 3672589136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14826': {'gid': 14826, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.29:6841/659023126', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6840', 'nonce': 659023126}, {'type': 'v1', 'addr': '172.21.15.29:6841', 'nonce': 659023126}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24595': {'gid': 24595, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6833/3104127935', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 3104127935}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 3104127935}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24599': {'gid': 24599, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6833/2941334623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6832', 'nonce': 2941334623}, {'type': 'v1', 'addr': '172.21.15.52:6833', 'nonce': 2941334623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/1200693038', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 1200693038}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 1200693038}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24629': {'gid': 24629, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.52:6835/2243548535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 2243548535}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 2243548535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24640': {'gid': 24640, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.66:6837/2021146216', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 2021146216}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 2021146216}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.52:6837/3446053314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 3446053314}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 3446053314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24655': {'gid': 24655, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.66:6839/3915731427', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 3915731427}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 3915731427}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24692': {'gid': 24692, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6839/1429145114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 1429145114}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 1429145114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24692, 'qdb_cluster': [24692, 24653, 24640, 24655, 24629]} 2024-09-21T07:09:29.444 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T07:09:29.444 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.e status 2024-09-21T07:09:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:29 smithi052 ceph-mon[34308]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:29.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:29 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1833432063' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:29.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:29 smithi066 ceph-mon[34793]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:29.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:29 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1833432063' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:09:29.705 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:30.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 -- 172.21.15.29:0/3255036675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a41094a0 msgr2=0x7fd6a41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 --2- 172.21.15.29:0/3255036675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a41094a0 0x7fd6a41098b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd698009ca0 tx=0x7fd69802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 -- 172.21.15.29:0/3255036675 shutdown_connections 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 --2- 172.21.15.29:0/3255036675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a4109df0 0x7fd6a4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 --2- 172.21.15.29:0/3255036675 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a41094a0 0x7fd6a41098b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 --2- 172.21.15.29:0/3255036675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6a4103b60 0x7fd6a4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 -- 172.21.15.29:0/3255036675 >> 172.21.15.29:0/3255036675 conn(0x7fd6a407b850 msgr2=0x7fd6a407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 -- 172.21.15.29:0/3255036675 shutdown_connections 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.177+0000 7fd6a937a640 1 -- 172.21.15.29:0/3255036675 wait complete. 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 Processor -- start 2024-09-21T07:09:30.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 -- start start 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a4103b60 0x7fd6a419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6a41094a0 0x7fd6a419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a4109df0 0x7fd6a419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4113ad0 con 0x7fd6a4109df0 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4113950 con 0x7fd6a4103b60 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a937a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4113c50 con 0x7fd6a41094a0 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a4109df0 0x7fd6a419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a4109df0 0x7fd6a419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33864/0 (socket says 172.21.15.29:33864) 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.178+0000 7fd6a37fe640 1 -- 172.21.15.29:0/1079670579 learned_addr learned my addr 172.21.15.29:0/1079670579 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a4103b60 0x7fd6a419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6a41094a0 0x7fd6a419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a37fe640 1 -- 172.21.15.29:0/1079670579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6a41094a0 msgr2=0x7fd6a419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6a41094a0 0x7fd6a419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a37fe640 1 -- 172.21.15.29:0/1079670579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a4103b60 msgr2=0x7fd6a419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a4103b60 0x7fd6a419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a37fe640 1 -- 172.21.15.29:0/1079670579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a41a0430 con 0x7fd6a4109df0 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a4103b60 0x7fd6a419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a4109df0 0x7fd6a419fd00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00d750 tx=0x7fd69c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd68bfff640 1 -- 172.21.15.29:0/1079670579 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c017070 con 0x7fd6a4109df0 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd68bfff640 1 -- 172.21.15.29:0/1079670579 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69c0054d0 con 0x7fd6a4109df0 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a41a0720 con 0x7fd6a4109df0 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd68bfff640 1 -- 172.21.15.29:0/1079670579 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c004c60 con 0x7fd6a4109df0 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.179+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41a6e80 con 0x7fd6a4109df0 2024-09-21T07:09:30.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 Processor -- start 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd68bfff640 1 -- 172.21.15.29:0/1079670579 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd69c009bd0 con 0x7fd6a4109df0 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 -- start start 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a948539c10 con 0x55a9481fb280 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a948529040 con 0x55a9481f30a0 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a94852ce50 con 0x55a94821bf60 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33870/0 (socket says 172.21.15.29:33870) 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1954647945 learned_addr learned my addr 172.21.15.29:0/1954647945 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:30.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.182+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1954647945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 msgr2=0x55a9485c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1954647945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 msgr2=0x55a9485c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1954647945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a948287540 con 0x55a9481fb280 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485c2980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd698009ca0 tx=0x7fd698009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad0f88caf9a6a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd68bfff640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd68c0b6510 0x7fd68c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd68c0b6510 0x7fd68c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6897fa640 1 -- 172.21.15.29:0/1954647945 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698031650 con 0x55a9481fb280 2024-09-21T07:09:30.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6897fa640 1 -- 172.21.15.29:0/1954647945 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd698036040 con 0x55a9481fb280 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd68bfff640 1 -- 172.21.15.29:0/1079670579 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd69c0e6dd0 con 0x7fd6a4109df0 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.183+0000 7fd6897fa640 1 -- 172.21.15.29:0/1954647945 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698004340 con 0x55a9481fb280 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1954647945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 msgr2=0x55a9485c2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd68c0b6510 0x7fd68c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55a9485c0b80 tx=0x7fd694008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485c2980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd698009ca0 tx=0x7fd698009360 comp rx=0 tx=0).stop 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1954647945 shutdown_connections 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485c2980 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1954647945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1954647945 >> 172.21.15.29:0/1954647945 conn(0x55a948210350 msgr2=0x55a9485bfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:30.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1954647945 shutdown_connections 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1954647945 wait complete. 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.184+0000 7fd6af8ee740 1 -- start start 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 1 Processor -- start 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485d9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a94838a5f0 con 0x55a9481fb280 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a9484c4010 con 0x55a9481f30a0 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a9485d0500 con 0x55a94821bf60 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6af8ee740 10 client.0 _ll_register_callbacks cb 0x55a948523340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33882/0 (socket says 172.21.15.29:33882) 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1558971455 learned_addr learned my addr 172.21.15.29:0/1558971455 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485d9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1558971455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 msgr2=0x55a9485d9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485d9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 msgr2=0x55a9485cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1558971455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9484f1a00 con 0x55a9481fb280 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.185+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485cdef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd698009400 tx=0x7fd698031970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83ad7fc9d8b4de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd686ff5640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd686ff5640 1 -- 172.21.15.29:0/1558971455 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698003d80 con 0x55a9481fb280 2024-09-21T07:09:30.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd686ff5640 1 -- 172.21.15.29:0/1558971455 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd698004120 con 0x55a9481fb280 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd698036040 con 0x55a9481fb280 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd686ff5640 1 -- 172.21.15.29:0/1558971455 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd698004320 con 0x55a9481fb280 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 10 client.15357 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a9485dc430 con 0x55a9481fb280 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd686ff5640 1 -- 172.21.15.29:0/1558971455 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd698036040 con 0x55a9481fb280 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd686ff5640 1 -- 172.21.15.29:0/1558971455 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd69802fc70 con 0x55a9481fb280 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 10 client.15357 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 10 client.15357 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 20 client.15357 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a9481da8e0 0x55a9485dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 4 client.15357 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.186+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 --> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a94853bb60 con 0x55a9481da8e0 2024-09-21T07:09:30.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.187+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a9481da8e0 0x55a9485dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.187+0000 7fd686ff5640 10 client.15357 ms_handle_connect on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.187+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a9481da8e0 0x55a9485dfad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fde25520b5005519 server_cookie=1dc7208201324bc6 in_seq=0 out_seq=0 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.188+0000 7fd686ff5640 1 -- 172.21.15.29:0/1558971455 <== mds.4 v2:172.21.15.52:6834/2243548535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a94853bb60 con 0x55a9481da8e0 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.188+0000 7fd686ff5640 10 client.15357 handle_command_reply: tid=0 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.188+0000 7fd6af8ee740 1 client.15357 shutdown 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 msgr2=0x55a9485cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485cdef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd698009400 tx=0x7fd698031970 comp rx=0 tx=0).stop 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 shutdown_connections 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a9481da8e0 0x55a9485dfad0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd686ff5640 0 client.15357 ms_handle_reset on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a94821bf60 0x55a9485d9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481fb280 0x55a9485cdef0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1558971455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 >> 172.21.15.29:0/1558971455 conn(0x55a948210350 msgr2=0x55a9485c5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 shutdown_connections 2024-09-21T07:09:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1558971455 wait complete. 2024-09-21T07:09:30.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.189+0000 7fd6af8ee740 20 client.15357 trim_cache size 0 max 16384 2024-09-21T07:09:30.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.207+0000 7fd6af8ee740 1 Processor -- start 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.207+0000 7fd6af8ee740 1 -- start start 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481da8e0 0x55a9485d9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481fb280 0x55a9485bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a9485dde10 con 0x55a9481da8e0 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a9485de4e0 con 0x55a9481f30a0 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a9485debb0 con 0x55a9481fb280 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481da8e0 0x55a9485d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481da8e0 0x55a9485d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33898/0 (socket says 172.21.15.29:33898) 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 -- 172.21.15.29:0/2751611132 learned_addr learned my addr 172.21.15.29:0/2751611132 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481fb280 0x55a9485bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 -- 172.21.15.29:0/2751611132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481fb280 msgr2=0x55a9485bf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481fb280 0x55a9485bf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 -- 172.21.15.29:0/2751611132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 msgr2=0x55a9485d9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485d9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 -- 172.21.15.29:0/2751611132 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a948528fd0 con 0x55a9481da8e0 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481fb280 0x55a9485bf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.208+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481da8e0 0x55a9485d9790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd69400f5b0 tx=0x7fd694015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d36a42b67d023f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.209+0000 7fd688ff9640 1 -- 172.21.15.29:0/2751611132 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69401b040 con 0x55a9481da8e0 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.209+0000 7fd688ff9640 1 -- 172.21.15.29:0/2751611132 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69402e070 con 0x55a9481da8e0 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.209+0000 7fd688ff9640 1 -- 172.21.15.29:0/2751611132 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694015610 con 0x55a9481da8e0 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 -- 172.21.15.29:0/2751611132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481da8e0 msgr2=0x55a9485d9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481da8e0 0x55a9485d9790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd69400f5b0 tx=0x7fd694015000 comp rx=0 tx=0).stop 2024-09-21T07:09:30.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 -- 172.21.15.29:0/2751611132 shutdown_connections 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481fb280 0x55a9485bf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481f30a0 0x55a9485d9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/2751611132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481da8e0 0x55a9485d9790 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 -- 172.21.15.29:0/2751611132 >> 172.21.15.29:0/2751611132 conn(0x55a948210350 msgr2=0x55a9485c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 -- 172.21.15.29:0/2751611132 shutdown_connections 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 -- 172.21.15.29:0/2751611132 wait complete. 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 -- start start 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.210+0000 7fd6af8ee740 1 Processor -- start 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481da8e0 0x55a9485e8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481f30a0 0x55a9485e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481fb280 0x55a9485e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55a9485df950 con 0x55a9481f30a0 2024-09-21T07:09:30.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a9485df280 con 0x55a9481fb280 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a9485e0020 con 0x55a9481da8e0 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 10 client.0 _ll_register_callbacks cb 0x7fd698032c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481f30a0 0x55a9485e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481f30a0 0x55a9485e1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33912/0 (socket says 172.21.15.29:33912) 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1371472307 learned_addr learned my addr 172.21.15.29:0/1371472307 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a37fe640 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481fb280 0x55a9485e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481da8e0 0x55a9485e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1371472307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481da8e0 msgr2=0x55a9485e8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481da8e0 0x55a9485e8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481fb280 msgr2=0x55a9485e1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481fb280 0x55a9485e1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 -- 172.21.15.29:0/1371472307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9485e26d0 con 0x55a9481f30a0 2024-09-21T07:09:30.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6a27fc640 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481f30a0 0x55a9485e1a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd698009ca0 tx=0x7fd698009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466c4c32464ceb49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd686ff5640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd686ff5640 1 -- 172.21.15.29:0/1371472307 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698067060 con 0x55a9481f30a0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd686ff5640 1 -- 172.21.15.29:0/1371472307 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd6980046c0 con 0x55a9481f30a0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.211+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd69402e070 con 0x55a9481f30a0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd686ff5640 1 -- 172.21.15.29:0/1371472307 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd698009540 con 0x55a9481f30a0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 10 client.15363 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a94864afa0 con 0x55a9481f30a0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd686ff5640 1 -- 172.21.15.29:0/1371472307 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69402e070 con 0x55a9481f30a0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd686ff5640 1 -- 172.21.15.29:0/1371472307 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd69802f680 con 0x55a9481f30a0 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 10 client.15363 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 10 client.15363 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 20 client.15363 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a94821bf60 0x55a94864e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:30.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 4 client.15363 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 --> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] -- command(tid 0: {"prefix": "status"}) -- 0x55a948537610 con 0x55a94821bf60 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.212+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a94821bf60 0x55a94864e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6a2ffd640 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a94821bf60 0x55a94864e6a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aee04530d03ed3bc server_cookie=6a33a5f2a0dac4c7 in_seq=0 out_seq=0 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd686ff5640 10 client.15363 ms_handle_connect on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd686ff5640 1 -- 172.21.15.29:0/1371472307 <== mds.4 v2:172.21.15.52:6834/2243548535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55a948537610 con 0x55a94821bf60 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd686ff5640 10 client.15363 handle_command_reply: tid=0 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 client.15363 shutdown 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481f30a0 msgr2=0x55a9485e1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481f30a0 0x55a9485e1a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd698009ca0 tx=0x7fd698009430 comp rx=0 tx=0).stop 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 shutdown_connections 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:6834/2243548535,v1:172.21.15.52:6835/2243548535] conn(0x55a94821bf60 0x55a94864e6a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9481fb280 0x55a9485e1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a9481f30a0 0x55a9485e1a20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd686ff5640 0 client.15363 ms_handle_reset on v2:172.21.15.52:6834/2243548535 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 --2- 172.21.15.29:0/1371472307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a9481da8e0 0x55a9485e8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 >> 172.21.15.29:0/1371472307 conn(0x55a948210350 msgr2=0x55a9485bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 shutdown_connections 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.213+0000 7fd6af8ee740 1 -- 172.21.15.29:0/1371472307 wait complete. 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6af8ee740 20 client.15363 trim_cache size 0 max 16384 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 4, 2024-09-21T07:09:30.226 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24629, 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 106.59538279, 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 146.52874467699999 2024-09-21T07:09:30.227 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd68c0b6510 msgr2=0x7fd68c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd68c0b6510 0x7fd68c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55a9485c0b80 tx=0x7fd694008040 comp rx=0 tx=0).stop 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a4109df0 msgr2=0x7fd6a419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a4109df0 0x7fd6a419fd00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00d750 tx=0x7fd69c00dc10 comp rx=0 tx=0).stop 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 shutdown_connections 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd68c0b6510 0x7fd68c0b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd6a4109df0 0x7fd6a419fd00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6a41094a0 0x7fd6a419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 --2- 172.21.15.29:0/1079670579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a4103b60 0x7fd6a419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:30.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 >> 172.21.15.29:0/1079670579 conn(0x7fd6a407b850 msgr2=0x7fd6a4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:30.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 shutdown_connections 2024-09-21T07:09:30.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:30.214+0000 7fd6a937a640 1 -- 172.21.15.29:0/1079670579 wait complete. 2024-09-21T07:09:31.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T07:09:31.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:31 smithi029 ceph-mon[30983]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:31.394 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:31.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:31 smithi052 ceph-mon[34308]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:31.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:31 smithi066 ceph-mon[34793]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:31.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.888+0000 7fd753e36640 1 -- 172.21.15.29:0/4068851621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c103210 msgr2=0x7fd74c103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.888+0000 7fd753e36640 1 --2- 172.21.15.29:0/4068851621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c103210 0x7fd74c103620 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd748009900 tx=0x7fd74802a410 comp rx=0 tx=0).stop 2024-09-21T07:09:31.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.888+0000 7fd753e36640 1 -- 172.21.15.29:0/4068851621 shutdown_connections 2024-09-21T07:09:31.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.888+0000 7fd753e36640 1 --2- 172.21.15.29:0/4068851621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd74c105b30 0x7fd74c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.888+0000 7fd753e36640 1 --2- 172.21.15.29:0/4068851621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd74c1051e0 0x7fd74c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.888+0000 7fd753e36640 1 --2- 172.21.15.29:0/4068851621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c103210 0x7fd74c103620 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.888+0000 7fd753e36640 1 -- 172.21.15.29:0/4068851621 >> 172.21.15.29:0/4068851621 conn(0x7fd74c079f90 msgr2=0x7fd74c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:31.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.889+0000 7fd753e36640 1 -- 172.21.15.29:0/4068851621 shutdown_connections 2024-09-21T07:09:31.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.889+0000 7fd753e36640 1 -- 172.21.15.29:0/4068851621 wait complete. 2024-09-21T07:09:31.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.889+0000 7fd753e36640 1 Processor -- start 2024-09-21T07:09:31.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.889+0000 7fd753e36640 1 -- start start 2024-09-21T07:09:31.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd753e36640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd74c103210 0x7fd74c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd753e36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd74c1051e0 0x7fd74c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd753e36640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c105b30 0x7fd74c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd753e36640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c1129d0 con 0x7fd74c105b30 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd753e36640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c112850 con 0x7fd74c1051e0 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd753e36640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c112b50 con 0x7fd74c103210 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c105b30 0x7fd74c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c105b30 0x7fd74c199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33934/0 (socket says 172.21.15.29:33934) 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 -- 172.21.15.29:0/3158977901 learned_addr learned my addr 172.21.15.29:0/3158977901 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd751bd2640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd74c103210 0x7fd74c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7513d1640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd74c1051e0 0x7fd74c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 -- 172.21.15.29:0/3158977901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd74c103210 msgr2=0x7fd74c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd74c103210 0x7fd74c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 -- 172.21.15.29:0/3158977901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd74c1051e0 msgr2=0x7fd74c1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd74c1051e0 0x7fd74c1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 -- 172.21.15.29:0/3158977901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c1a8860 con 0x7fd74c105b30 2024-09-21T07:09:31.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7513d1640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd74c1051e0 0x7fd74c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:31.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.890+0000 7fd7523d3640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c105b30 0x7fd74c199c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd74400eaa0 tx=0x7fd74400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:31.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.891+0000 7fd742ffd640 1 -- 172.21.15.29:0/3158977901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74400cdb0 con 0x7fd74c105b30 2024-09-21T07:09:31.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.891+0000 7fd742ffd640 1 -- 172.21.15.29:0/3158977901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd744005020 con 0x7fd74c105b30 2024-09-21T07:09:31.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.891+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c1a8b50 con 0x7fd74c105b30 2024-09-21T07:09:31.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.891+0000 7fd742ffd640 1 -- 172.21.15.29:0/3158977901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7440116d0 con 0x7fd74c105b30 2024-09-21T07:09:31.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.891+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c1a9040 con 0x7fd74c105b30 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.893+0000 7fd75a3aa740 1 Processor -- start 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.893+0000 7fd742ffd640 1 -- 172.21.15.29:0/3158977901 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd7440051d0 con 0x7fd74c105b30 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd75a3aa740 1 -- start start 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f2ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f2f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f2f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561168ea6c10 con 0x561168b68280 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561168e96040 con 0x561168b88f60 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561168e99e50 con 0x561168b600a0 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f2f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f2f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33942/0 (socket says 172.21.15.29:33942) 2024-09-21T07:09:31.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 -- 172.21.15.29:0/644857005 learned_addr learned my addr 172.21.15.29:0/644857005 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f2ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd751bd2640 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f2f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd742ffd640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd7380b6510 0x7fd7380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 -- 172.21.15.29:0/644857005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 msgr2=0x561168f2f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f2f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 -- 172.21.15.29:0/644857005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 msgr2=0x561168f2ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.894+0000 7fd7513d1640 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f2ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.895+0000 7fd7513d1640 1 -- 172.21.15.29:0/644857005 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561168bf4540 con 0x561168b68280 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.895+0000 7fd7523d3640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd7380b6510 0x7fd7380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.895+0000 7fd742ffd640 1 -- 172.21.15.29:0/3158977901 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd7440e7430 con 0x7fd74c105b30 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.895+0000 7fd7513d1640 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f2f980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd73c014a20 tx=0x7fd73c00c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd82d2b0b9a449bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.895+0000 7fd737fff640 1 -- 172.21.15.29:0/644857005 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0142d0 con 0x561168b68280 2024-09-21T07:09:31.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.895+0000 7fd737fff640 1 -- 172.21.15.29:0/644857005 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd73c00f760 con 0x561168b68280 2024-09-21T07:09:31.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.895+0000 7fd737fff640 1 -- 172.21.15.29:0/644857005 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c003830 con 0x561168b68280 2024-09-21T07:09:31.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 -- 172.21.15.29:0/644857005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 msgr2=0x561168f2f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f2f980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd73c014a20 tx=0x7fd73c00c540 comp rx=0 tx=0).stop 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd7523d3640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd7380b6510 0x7fd7380b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd7440ad560 tx=0x7fd74400e280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 -- 172.21.15.29:0/644857005 shutdown_connections 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f2f980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f2f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/644857005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f2ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 -- 172.21.15.29:0/644857005 >> 172.21.15.29:0/644857005 conn(0x561168b7d350 msgr2=0x561168f2cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 -- 172.21.15.29:0/644857005 shutdown_connections 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 -- 172.21.15.29:0/644857005 wait complete. 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.896+0000 7fd75a3aa740 1 -- start start 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 1 Processor -- start 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f3af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561168cf75f0 con 0x561168b68280 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561168e31010 con 0x561168b88f60 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561168f3d680 con 0x561168b600a0 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd75a3aa740 10 client.0 _ll_register_callbacks cb 0x561168e90340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd751bd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f3af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd751bd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f3af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33950/0 (socket says 172.21.15.29:33950) 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd751bd2640 1 -- 172.21.15.29:0/2646346793 learned_addr learned my addr 172.21.15.29:0/2646346793 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd7513d1640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.897+0000 7fd7513d1640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd751bd2640 1 -- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 msgr2=0x561168f3a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd751bd2640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f3a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd751bd2640 1 -- 172.21.15.29:0/2646346793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 msgr2=0x561168f46970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd751bd2640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd751bd2640 1 -- 172.21.15.29:0/2646346793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561168e5ea00 con 0x561168b68280 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd7513d1640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd751bd2640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f3af00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd748009900 tx=0x7fd748032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aac8e8d02fb785 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd7357fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd7357fa640 1 -- 172.21.15.29:0/2646346793 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748035040 con 0x561168b68280 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd7357fa640 1 -- 172.21.15.29:0/2646346793 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd748031860 con 0x561168b68280 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd73c00f760 con 0x561168b68280 2024-09-21T07:09:31.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd7357fa640 1 -- 172.21.15.29:0/2646346793 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd748004040 con 0x561168b68280 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd75a3aa740 10 client.15375 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561168f495a0 con 0x561168b68280 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.898+0000 7fd7357fa640 1 -- 172.21.15.29:0/2646346793 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd73c00f760 con 0x561168b68280 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd7357fa640 1 -- 172.21.15.29:0/2646346793 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd748004750 con 0x561168b68280 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd75a3aa740 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd75a3aa740 10 client.15375 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd75a3aa740 20 client.15375 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b478e0 0x561168f4d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd75a3aa740 4 client.15375 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 --> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561168ea8b60 con 0x561168b478e0 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd7513d1640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b478e0 0x561168f4d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd7513d1640 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b478e0 0x561168f4d040 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5b5f8389c9ed0837 server_cookie=e098b21e8f4cd0d5 in_seq=0 out_seq=0 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.899+0000 7fd7357fa640 10 client.15375 ms_handle_connect on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.900+0000 7fd7357fa640 1 -- 172.21.15.29:0/2646346793 <== mds.3 v2:172.21.15.66:6836/2021146216 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561168ea8b60 con 0x561168b478e0 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.900+0000 7fd7357fa640 10 client.15375 handle_command_reply: tid=0 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.900+0000 7fd75a3aa740 1 client.15375 shutdown 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.900+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 msgr2=0x561168f3af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.900+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f3af00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd748009900 tx=0x7fd748032f60 comp rx=0 tx=0).stop 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 shutdown_connections 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b478e0 0x561168f4d040 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f3af00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd7357fa640 0 client.15375 ms_handle_reset on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:31.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2646346793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f3a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 >> 172.21.15.29:0/2646346793 conn(0x561168b7d350 msgr2=0x561168f320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:31.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 shutdown_connections 2024-09-21T07:09:31.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2646346793 wait complete. 2024-09-21T07:09:31.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.901+0000 7fd75a3aa740 20 client.15375 trim_cache size 0 max 16384 2024-09-21T07:09:31.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 Processor -- start 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 -- start start 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f39cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561168f4b380 con 0x561168b68280 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561168f4ba50 con 0x561168b88f60 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561168f4c120 con 0x561168b600a0 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd751bd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd751bd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33966/0 (socket says 172.21.15.29:33966) 2024-09-21T07:09:31.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.919+0000 7fd751bd2640 1 -- 172.21.15.29:0/2452719713 learned_addr learned my addr 172.21.15.29:0/2452719713 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd7513d1640 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f39cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd751bd2640 1 -- 172.21.15.29:0/2452719713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 msgr2=0x561168f39cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd751bd2640 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f39cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd751bd2640 1 -- 172.21.15.29:0/2452719713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 msgr2=0x561168f46e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd751bd2640 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd751bd2640 1 -- 172.21.15.29:0/2452719713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561168f3ba80 con 0x561168b68280 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd7513d1640 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f39cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd751bd2640 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f468e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd748006010 tx=0x7fd7480314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f63e1ac8f5cdffd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd7377fe640 1 -- 172.21.15.29:0/2452719713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748035030 con 0x561168b68280 2024-09-21T07:09:31.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd7377fe640 1 -- 172.21.15.29:0/2452719713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd748005850 con 0x561168b68280 2024-09-21T07:09:31.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.920+0000 7fd7377fe640 1 -- 172.21.15.29:0/2452719713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7480044e0 con 0x561168b68280 2024-09-21T07:09:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2452719713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 msgr2=0x561168f468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f468e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd748006010 tx=0x7fd7480314a0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2452719713 shutdown_connections 2024-09-21T07:09:31.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f46e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b68280 0x561168f468e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/2452719713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b600a0 0x561168f39cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2452719713 >> 172.21.15.29:0/2452719713 conn(0x561168b7d350 msgr2=0x561168f3a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2452719713 shutdown_connections 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 -- 172.21.15.29:0/2452719713 wait complete. 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 -- start start 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.921+0000 7fd75a3aa740 1 Processor -- start 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b600a0 0x561168f55920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b68280 0x561168f4ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd75a3aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f4f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x561168f4cec0 con 0x561168b600a0 2024-09-21T07:09:31.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561168f4c7f0 con 0x561168b88f60 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd75a3aa740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561168f4d590 con 0x561168b68280 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd75a3aa740 10 client.0 _ll_register_callbacks cb 0x7fd748005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b600a0 0x561168f55920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b600a0 0x561168f55920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33972/0 (socket says 172.21.15.29:33972) 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 -- 172.21.15.29:0/1420334077 learned_addr learned my addr 172.21.15.29:0/1420334077 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd751bd2640 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b68280 0x561168f4ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 -- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b68280 msgr2=0x561168f4ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b68280 0x561168f4ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 -- 172.21.15.29:0/1420334077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 msgr2=0x561168f4f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f4f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 -- 172.21.15.29:0/1420334077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561168f4f950 con 0x561168b600a0 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd751bd2640 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b68280 0x561168f4ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:31.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7513d1640 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b600a0 0x561168f55920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd73c014a20 tx=0x7fd73c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a81d4653975906 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.922+0000 7fd7357fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd7357fa640 1 -- 172.21.15.29:0/1420334077 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c031070 con 0x561168b600a0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd7357fa640 1 -- 172.21.15.29:0/1420334077 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fd73c004230 con 0x561168b600a0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd748005850 con 0x561168b600a0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd7357fa640 1 -- 172.21.15.29:0/1420334077 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd73c00c400 con 0x561168b600a0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 10 client.15381 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561168f55270 con 0x561168b600a0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd7357fa640 1 -- 172.21.15.29:0/1420334077 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd748005850 con 0x561168b600a0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd7357fa640 1 -- 172.21.15.29:0/1420334077 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd73c0035f0 con 0x561168b600a0 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 10 client.15381 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 10 client.15381 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 20 client.15381 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:31.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b1cc90 0x561168fbb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 4 client.15381 mds_command: new command op to 24640 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.923+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 --> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] -- command(tid 0: {"prefix": "status"}) -- 0x561168ea4610 con 0x561168b1cc90 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.924+0000 7fd751bd2640 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b1cc90 0x561168fbb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.924+0000 7fd7357fa640 10 client.15381 ms_handle_connect on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.924+0000 7fd751bd2640 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b1cc90 0x561168fbb8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a87539ddae81cc83 server_cookie=7a8fffb51d7b90ee in_seq=0 out_seq=0 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.924+0000 7fd7357fa640 1 -- 172.21.15.29:0/1420334077 <== mds.3 v2:172.21.15.66:6836/2021146216 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561168ea4610 con 0x561168b1cc90 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.924+0000 7fd7357fa640 10 client.15381 handle_command_reply: tid=0 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.924+0000 7fd75a3aa740 1 client.15381 shutdown 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b600a0 msgr2=0x561168f55920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b600a0 0x561168f55920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd73c014a20 tx=0x7fd73c00cf40 comp rx=0 tx=0).stop 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 shutdown_connections 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:6836/2021146216,v1:172.21.15.66:6837/2021146216] conn(0x561168b1cc90 0x561168fbb8f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561168b88f60 0x561168f4f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561168b68280 0x561168f4ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd7357fa640 0 client.15381 ms_handle_reset on v2:172.21.15.66:6836/2021146216 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 --2- 172.21.15.29:0/1420334077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x561168b600a0 0x561168f55920 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 >> 172.21.15.29:0/1420334077 conn(0x561168b7d350 msgr2=0x561168f359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 shutdown_connections 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 1 -- 172.21.15.29:0/1420334077 wait complete. 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd75a3aa740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:31.932 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 3, 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24640, 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 109.313060652, 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 143.20482214099999 2024-09-21T07:09:31.933 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd7380b6510 msgr2=0x7fd7380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd753e36640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd7380b6510 0x7fd7380b8a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd7440ad560 tx=0x7fd74400e280 comp rx=0 tx=0).stop 2024-09-21T07:09:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c105b30 msgr2=0x7fd74c199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.925+0000 7fd753e36640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c105b30 0x7fd74c199c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd74400eaa0 tx=0x7fd74400ef60 comp rx=0 tx=0).stop 2024-09-21T07:09:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 shutdown_connections 2024-09-21T07:09:31.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fd7380b6510 0x7fd7380b8a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd74c105b30 0x7fd74c199c30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd74c1051e0 0x7fd74c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 --2- 172.21.15.29:0/3158977901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd74c103210 0x7fd74c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 >> 172.21.15.29:0/3158977901 conn(0x7fd74c079f90 msgr2=0x7fd74c107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 shutdown_connections 2024-09-21T07:09:31.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:31.926+0000 7fd753e36640 1 -- 172.21.15.29:0/3158977901 wait complete. 2024-09-21T07:09:32.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T07:09:33.073 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:33.347 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:33 smithi029 ceph-mon[30983]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:33.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:33 smithi052 ceph-mon[34308]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:33.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/505114365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 msgr2=0x7f6cd0107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/505114365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd0107f40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009900 tx=0x7f6cc402a410 comp rx=0 tx=0).stop 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/505114365 shutdown_connections 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/505114365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd0108480 0x7f6cd010ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/505114365 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd0107f40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/505114365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd01021f0 0x7f6cd0102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/505114365 >> 172.21.15.29:0/505114365 conn(0x7f6cd0077c60 msgr2=0x7f6cd00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/505114365 shutdown_connections 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.561+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/505114365 wait complete. 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.562+0000 7f6cd4a8c640 1 Processor -- start 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.562+0000 7f6cd4a8c640 1 -- start start 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cd4a8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd01021f0 0x7f6cd019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cd4a8c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cd4a8c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd0108480 0x7f6cd019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cd4a8c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd01118c0 con 0x7f6cd0107b30 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cd4a8c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0111740 con 0x7f6cd01021f0 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cd4a8c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0111a40 con 0x7f6cd0108480 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33982/0 (socket says 172.21.15.29:33982) 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3721885537 learned_addr learned my addr 172.21.15.29:0/3721885537 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cced9d640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd0108480 0x7f6cd019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cce59c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd01021f0 0x7f6cd019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3721885537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd0108480 msgr2=0x7f6cd019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd0108480 0x7f6cd019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3721885537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd01021f0 msgr2=0x7f6cd019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd01021f0 0x7f6cd019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3721885537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01a0420 con 0x7f6cd0107b30 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6cced9d640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd0108480 0x7f6cd019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.563+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd019aa50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6cc402a930 tx=0x7f6cc4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.564+0000 7f6cbf7fe640 1 -- 172.21.15.29:0/3721885537 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc403f030 con 0x7f6cd0107b30 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.564+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd01a06b0 con 0x7f6cd0107b30 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.564+0000 7f6cbf7fe640 1 -- 172.21.15.29:0/3721885537 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cc4004490 con 0x7f6cd0107b30 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.564+0000 7f6cbf7fe640 1 -- 172.21.15.29:0/3721885537 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4035070 con 0x7f6cd0107b30 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.564+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01a6e70 con 0x7f6cd0107b30 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.566+0000 7f6cbf7fe640 1 -- 172.21.15.29:0/3721885537 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6cc4042030 con 0x7f6cd0107b30 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.567+0000 7f6cbf7fe640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6cb80b6510 0x7f6cb80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.567+0000 7f6cdb000740 1 Processor -- start 2024-09-21T07:09:33.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.567+0000 7f6cbf7fe640 1 -- 172.21.15.29:0/3721885537 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6cc41073d0 con 0x7f6cd0107b30 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.567+0000 7f6cce59c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6cb80b6510 0x7f6cb80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cdb000740 1 -- start start 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250c4f60 0x558c2546af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cce59c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6cb80b6510 0x7f6cb80b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000abd0 tx=0x7f6cc0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c2509c0a0 0x558c2546b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2546b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cdb000740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558c253e2c10 con 0x558c2509c0a0 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cdb000740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558c253d2040 con 0x558c250c4f60 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cdb000740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558c253d5e50 con 0x558c250a4280 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c2509c0a0 0x558c2546b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c2509c0a0 0x558c2546b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33992/0 (socket says 172.21.15.29:33992) 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/614945420 learned_addr learned my addr 172.21.15.29:0/614945420 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cced9d640 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2546b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cce59c640 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250c4f60 0x558c2546af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cced9d640 1 -- 172.21.15.29:0/614945420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250c4f60 msgr2=0x558c2546af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cced9d640 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250c4f60 0x558c2546af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cced9d640 1 -- 172.21.15.29:0/614945420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c2509c0a0 msgr2=0x558c2546b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cced9d640 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c2509c0a0 0x558c2546b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6cced9d640 1 -- 172.21.15.29:0/614945420 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c25130540 con 0x558c250a4280 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.568+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c2509c0a0 0x558c2546b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.569+0000 7f6cced9d640 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2546b980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009f90 tx=0x7f6cc8010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2632d6aa8e8bf744 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.569+0000 7f6cbcff9640 1 -- 172.21.15.29:0/614945420 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8004d20 con 0x558c250a4280 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.569+0000 7f6cbcff9640 1 -- 172.21.15.29:0/614945420 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cc80119b0 con 0x558c250a4280 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.569+0000 7f6cbcff9640 1 -- 172.21.15.29:0/614945420 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8005550 con 0x558c250a4280 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 -- 172.21.15.29:0/614945420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 msgr2=0x558c2546b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2546b980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009f90 tx=0x7f6cc8010860 comp rx=0 tx=0).stop 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 -- 172.21.15.29:0/614945420 shutdown_connections 2024-09-21T07:09:33.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2546b980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c2509c0a0 0x558c2546b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 --2- 172.21.15.29:0/614945420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250c4f60 0x558c2546af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 -- 172.21.15.29:0/614945420 >> 172.21.15.29:0/614945420 conn(0x558c250b9350 msgr2=0x558c25468df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 -- 172.21.15.29:0/614945420 shutdown_connections 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 -- 172.21.15.29:0/614945420 wait complete. 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 -- start start 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.570+0000 7f6cdb000740 1 Processor -- start 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c2547aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2547b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c25486da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cdb000740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558c252335f0 con 0x558c250c4f60 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cdb000740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558c2536d010 con 0x558c2509c0a0 2024-09-21T07:09:33.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cdb000740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558c2547da40 con 0x558c250a4280 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cdb000740 10 client.0 _ll_register_callbacks cb 0x558c253cc340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c25486da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c25486da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34008/0 (socket says 172.21.15.29:34008) 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 -- 172.21.15.29:0/978940540 learned_addr learned my addr 172.21.15.29:0/978940540 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cce59c640 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c2547aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2547b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 -- 172.21.15.29:0/978940540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 msgr2=0x558c2547b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2547b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 -- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 msgr2=0x558c2547aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c2547aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 -- 172.21.15.29:0/978940540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c2539aa00 con 0x558c250c4f60 2024-09-21T07:09:33.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cced9d640 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c25486da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8005170 tx=0x7f6cc8011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5507ce6795ad34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.571+0000 7f6cb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/978940540 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc802b060 con 0x558c250c4f60 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/978940540 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6cc8004a40 con 0x558c250c4f60 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc80119b0 con 0x558c250c4f60 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/978940540 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6cc8004c40 con 0x558c250c4f60 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 10 client.15393 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558c25489970 con 0x558c250c4f60 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/978940540 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cc80119b0 con 0x558c250c4f60 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/978940540 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6cc801b6d0 con 0x558c250c4f60 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 10 client.15393 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 20 client.15393 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:33.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c250838e0 0x558c2548d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 4 client.15393 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.572+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 --> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c253e4b60 con 0x558c250838e0 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.573+0000 7f6cce59c640 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c250838e0 0x558c2548d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.573+0000 7f6cb5ffb640 10 client.15393 ms_handle_connect on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.573+0000 7f6cce59c640 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c250838e0 0x558c2548d0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e929971c2e5cc365 server_cookie=b8096351008bf261 in_seq=0 out_seq=0 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/978940540 <== mds.2 v2:172.21.15.52:6836/3446053314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c253e4b60 con 0x558c250838e0 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cb5ffb640 10 client.15393 handle_command_reply: tid=0 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 client.15393 shutdown 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 msgr2=0x558c25486da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c25486da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8005170 tx=0x7f6cc8011f90 comp rx=0 tx=0).stop 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 shutdown_connections 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c250838e0 0x558c2548d0c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c25486da0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250a4280 0x558c2547b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cb5ffb640 0 client.15393 ms_handle_reset on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 --2- 172.21.15.29:0/978940540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c2547aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 >> 172.21.15.29:0/978940540 conn(0x558c250b9350 msgr2=0x558c254673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 shutdown_connections 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 1 -- 172.21.15.29:0/978940540 wait complete. 2024-09-21T07:09:33.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.574+0000 7f6cdb000740 20 client.15393 trim_cache size 0 max 16384 2024-09-21T07:09:33.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 Processor -- start 2024-09-21T07:09:33.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 -- start start 2024-09-21T07:09:33.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c25468030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250a4280 0x558c25468750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250c4f60 0x558c25486d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558c2548b400 con 0x558c250a4280 2024-09-21T07:09:33.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558c2548bad0 con 0x558c2509c0a0 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cdb000740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558c2548c1a0 con 0x558c250c4f60 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250a4280 0x558c25468750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6ccdd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250a4280 0x558c25468750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34012/0 (socket says 172.21.15.29:34012) 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3393940274 learned_addr learned my addr 172.21.15.29:0/3393940274 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cced9d640 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250c4f60 0x558c25486d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.593+0000 7f6cce59c640 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c25468030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3393940274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250c4f60 msgr2=0x558c25486d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250c4f60 0x558c25486d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3393940274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 msgr2=0x558c25468030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c25468030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6ccdd9b640 1 -- 172.21.15.29:0/3393940274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c25469310 con 0x558c250a4280 2024-09-21T07:09:33.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6cce59c640 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c25468030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:33.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250a4280 0x558c25468750 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40c9cd0 tx=0x7f6cc402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37710f20e1a255a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:33.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6cb7fff640 1 -- 172.21.15.29:0/3393940274 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4049040 con 0x558c250a4280 2024-09-21T07:09:33.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6cb7fff640 1 -- 172.21.15.29:0/3393940274 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cc40d1ff0 con 0x558c250a4280 2024-09-21T07:09:33.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.594+0000 7f6cb7fff640 1 -- 172.21.15.29:0/3393940274 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40c8e60 con 0x558c250a4280 2024-09-21T07:09:33.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 -- 172.21.15.29:0/3393940274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250a4280 msgr2=0x558c25468750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250a4280 0x558c25468750 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40c9cd0 tx=0x7f6cc402a410 comp rx=0 tx=0).stop 2024-09-21T07:09:33.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 -- 172.21.15.29:0/3393940274 shutdown_connections 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c250c4f60 0x558c25486d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250a4280 0x558c25468750 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 --2- 172.21.15.29:0/3393940274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c2509c0a0 0x558c25468030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 -- 172.21.15.29:0/3393940274 >> 172.21.15.29:0/3393940274 conn(0x558c250b9350 msgr2=0x558c2547a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 -- 172.21.15.29:0/3393940274 shutdown_connections 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.595+0000 7f6cdb000740 1 -- 172.21.15.29:0/3393940274 wait complete. 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 -- start start 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 Processor -- start 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c2509c0a0 0x558c254959d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250a4280 0x558c2548ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c2548f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x558c2548cf40 con 0x558c250c4f60 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558c2548c870 con 0x558c250a4280 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558c2548d610 con 0x558c2509c0a0 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cdb000740 10 client.0 _ll_register_callbacks cb 0x7f6cc403b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c2548f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c2509c0a0 0x558c254959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c2548f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34026/0 (socket says 172.21.15.29:34026) 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c2509c0a0 0x558c254959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.29:55658/0 (socket says 172.21.15.29:55658) 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6cced9d640 1 -- 172.21.15.29:0/1959341576 learned_addr learned my addr 172.21.15.29:0/1959341576 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.596+0000 7f6ccdd9b640 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250a4280 0x558c2548ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cced9d640 1 -- 172.21.15.29:0/1959341576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c2509c0a0 msgr2=0x558c254959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cced9d640 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c2509c0a0 0x558c254959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cced9d640 1 -- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250a4280 msgr2=0x558c2548ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cced9d640 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250a4280 0x558c2548ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cced9d640 1 -- 172.21.15.29:0/1959341576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c2548f9d0 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cce59c640 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c2509c0a0 0x558c254959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cced9d640 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c2548f3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80051a0 tx=0x7f6cc8009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ec88a02a4c0640 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/1959341576 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc803e060 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/1959341576 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6cc80118d0 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc40d1ff0 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/1959341576 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6cc802b030 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cdb000740 10 client.15399 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.597+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558c254953e0 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/1959341576 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cc801b8e0 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/1959341576 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6cc8026470 con 0x558c250c4f60 2024-09-21T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cdb000740 10 client.15399 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cdb000740 10 client.15399 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cdb000740 20 client.15399 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cdb000740 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c25058c90 0x558c254fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cdb000740 4 client.15399 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 --> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] -- command(tid 0: {"prefix": "status"}) -- 0x7f6cc40d1ff0 con 0x558c25058c90 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.598+0000 7f6cce59c640 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c25058c90 0x558c254fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cce59c640 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c25058c90 0x558c254fbb70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5dd4c8e2024f1e2c server_cookie=7b846f7af955f17f in_seq=0 out_seq=0 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cb5ffb640 10 client.15399 ms_handle_connect on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cb5ffb640 1 -- 172.21.15.29:0/1959341576 <== mds.2 v2:172.21.15.52:6836/3446053314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x7f6cc40d1ff0 con 0x558c25058c90 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cb5ffb640 10 client.15399 handle_command_reply: tid=0 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 client.15399 shutdown 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 msgr2=0x558c2548f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c2548f3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80051a0 tx=0x7f6cc8009e80 comp rx=0 tx=0).stop 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 shutdown_connections 2024-09-21T07:09:33.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:6836/3446053314,v1:172.21.15.52:6837/3446053314] conn(0x558c25058c90 0x558c254fbb70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c250c4f60 0x558c2548f3c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558c250a4280 0x558c2548ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 --2- 172.21.15.29:0/1959341576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558c2509c0a0 0x558c254959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 >> 172.21.15.29:0/1959341576 conn(0x558c250b9350 msgr2=0x558c25475ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cb5ffb640 0 client.15399 ms_handle_reset on v2:172.21.15.52:6836/3446053314 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 shutdown_connections 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.599+0000 7f6cdb000740 1 -- 172.21.15.29:0/1959341576 wait complete. 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cdb000740 20 client.15399 trim_cache size 0 max 16384 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:33.606 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 2, 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24653, 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 111.997235531, 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 142.16088717599999 2024-09-21T07:09:33.607 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6cb80b6510 msgr2=0x7f6cb80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6cb80b6510 0x7f6cb80b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000abd0 tx=0x7f6cc0005f90 comp rx=0 tx=0).stop 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 msgr2=0x7f6cd019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd019aa50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6cc402a930 tx=0x7f6cc4031a20 comp rx=0 tx=0).stop 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 shutdown_connections 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6cb80b6510 0x7f6cb80b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd0108480 0x7f6cd019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0107b30 0x7f6cd019aa50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 --2- 172.21.15.29:0/3721885537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd01021f0 0x7f6cd019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:33.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 >> 172.21.15.29:0/3721885537 conn(0x7f6cd0077c60 msgr2=0x7f6cd0105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:33.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 shutdown_connections 2024-09-21T07:09:33.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:33.600+0000 7f6cd4a8c640 1 -- 172.21.15.29:0/3721885537 wait complete. 2024-09-21T07:09:33.609 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:33 smithi066 ceph-mon[34793]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:34.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T07:09:34.785 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:35.190 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:35 smithi029 ceph-mon[30983]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:35.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 -- 172.21.15.29:0/2384677367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340108cf0 msgr2=0x7f534010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 --2- 172.21.15.29:0/2384677367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340108cf0 0x7f534010f520 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5338009ca0 tx=0x7f533802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 -- 172.21.15.29:0/2384677367 shutdown_connections 2024-09-21T07:09:35.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 --2- 172.21.15.29:0/2384677367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340108cf0 0x7f534010f520 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 --2- 172.21.15.29:0/2384677367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53401083a0 0x7f53401087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 --2- 172.21.15.29:0/2384677367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5340102a60 0x7f5340102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 -- 172.21.15.29:0/2384677367 >> 172.21.15.29:0/2384677367 conn(0x7f5340079730 msgr2=0x7f5340079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 -- 172.21.15.29:0/2384677367 shutdown_connections 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.282+0000 7f5345493640 1 -- 172.21.15.29:0/2384677367 wait complete. 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.283+0000 7f5345493640 1 Processor -- start 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.283+0000 7f5345493640 1 -- start start 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.283+0000 7f5345493640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340102a60 0x7f534019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.283+0000 7f5345493640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53401083a0 0x7f534019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.283+0000 7f5345493640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5340108cf0 0x7f534019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5345493640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5340113ac0 con 0x7f5340102a60 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5345493640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5340113940 con 0x7f53401083a0 2024-09-21T07:09:35.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5345493640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5340113c40 con 0x7f5340108cf0 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340102a60 0x7f534019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340102a60 0x7f534019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34048/0 (socket says 172.21.15.29:34048) 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 -- 172.21.15.29:0/3628402479 learned_addr learned my addr 172.21.15.29:0/3628402479 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533e7fc640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53401083a0 0x7f534019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533f7fe640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5340108cf0 0x7f534019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 -- 172.21.15.29:0/3628402479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5340108cf0 msgr2=0x7f534019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5340108cf0 0x7f534019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 -- 172.21.15.29:0/3628402479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53401083a0 msgr2=0x7f534019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53401083a0 0x7f534019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 -- 172.21.15.29:0/3628402479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53401a0380 con 0x7f5340102a60 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533e7fc640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53401083a0 0x7f534019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f533effd640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340102a60 0x7f534019a4d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f533000b4a0 tx=0x7f533000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5327fff640 1 -- 172.21.15.29:0/3628402479 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330014070 con 0x7f5340102a60 2024-09-21T07:09:35.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53401a0670 con 0x7f5340102a60 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5327fff640 1 -- 172.21.15.29:0/3628402479 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5330010ac0 con 0x7f5340102a60 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5327fff640 1 -- 172.21.15.29:0/3628402479 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330017c30 con 0x7f5340102a60 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.284+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53401a6e90 con 0x7f5340102a60 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.287+0000 7f534ba07740 1 Processor -- start 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.287+0000 7f534ba07740 1 -- start start 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.287+0000 7f5327fff640 1 -- 172.21.15.29:0/3628402479 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5330017070 con 0x7f5340102a60 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.287+0000 7f534ba07740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5afef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.287+0000 7f534ba07740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5aff440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.287+0000 7f534ba07740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5aff980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f534ba07740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5a76c10 con 0x55c9e5758f60 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f534ba07740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5a66040 con 0x55c9e57300a0 2024-09-21T07:09:35.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f534ba07740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5a69e50 con 0x55c9e5738280 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5afef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5afef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34058/0 (socket says 172.21.15.29:34058) 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 -- 172.21.15.29:0/452185137 learned_addr learned my addr 172.21.15.29:0/452185137 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533effd640 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5aff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533e7fc640 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5aff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 -- 172.21.15.29:0/452185137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 msgr2=0x55c9e5aff980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5aff980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 -- 172.21.15.29:0/452185137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 msgr2=0x55c9e5aff440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5aff440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 -- 172.21.15.29:0/452185137 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9e57c4540 con 0x55c9e5758f60 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f5327fff640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f53280b6540 0x7f53280b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533f7fe640 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5afef00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5338009930 tx=0x7f5338009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3055b133d2ab715 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.288+0000 7f533effd640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f53280b6540 0x7f53280b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.289+0000 7f53257fa640 1 -- 172.21.15.29:0/452185137 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338031df0 con 0x55c9e5758f60 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.289+0000 7f53257fa640 1 -- 172.21.15.29:0/452185137 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5338036040 con 0x55c9e5758f60 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.289+0000 7f53257fa640 1 -- 172.21.15.29:0/452185137 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338004330 con 0x55c9e5758f60 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.289+0000 7f5327fff640 1 -- 172.21.15.29:0/3628402479 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f53300e65a0 con 0x7f5340102a60 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.289+0000 7f534ba07740 1 -- 172.21.15.29:0/452185137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 msgr2=0x55c9e5afef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.289+0000 7f533effd640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f53280b6540 0x7f53280b8a50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c9e5afdb80 tx=0x7f53300eb040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.289+0000 7f534ba07740 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5afef00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5338009930 tx=0x7f5338009960 comp rx=0 tx=0).stop 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- 172.21.15.29:0/452185137 shutdown_connections 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5aff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5aff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 --2- 172.21.15.29:0/452185137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5afef00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- 172.21.15.29:0/452185137 >> 172.21.15.29:0/452185137 conn(0x55c9e574d350 msgr2=0x55c9e5afcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:35.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- 172.21.15.29:0/452185137 shutdown_connections 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- 172.21.15.29:0/452185137 wait complete. 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- start start 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 Processor -- start 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5738280 0x55c9e5b0af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5758f60 0x55c9e5b169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9e58c75f0 con 0x55c9e5738280 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5a01010 con 0x55c9e57300a0 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5b0d680 con 0x55c9e5758f60 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.290+0000 7f534ba07740 10 client.0 _ll_register_callbacks cb 0x55c9e5a60340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5738280 0x55c9e5b0af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5738280 0x55c9e5b0af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34074/0 (socket says 172.21.15.29:34074) 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 -- 172.21.15.29:0/1194464193 learned_addr learned my addr 172.21.15.29:0/1194464193 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:35.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5758f60 0x55c9e5b169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 -- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5758f60 msgr2=0x55c9e5b169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5758f60 0x55c9e5b169a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 -- 172.21.15.29:0/1194464193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 msgr2=0x55c9e5b0aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 -- 172.21.15.29:0/1194464193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9e5a2ea00 con 0x55c9e5738280 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f533e7fc640 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5738280 0x55c9e5b0af50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f53340117e0 tx=0x7f5334011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f4a2334fb9b743 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f5322ff5640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f5322ff5640 1 -- 172.21.15.29:0/1194464193 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533400f8c0 con 0x55c9e5738280 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f5322ff5640 1 -- 172.21.15.29:0/1194464193 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f533400fa60 con 0x55c9e5738280 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.291+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5338036040 con 0x55c9e5738280 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f5322ff5640 1 -- 172.21.15.29:0/1194464193 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f533400fc60 con 0x55c9e5738280 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 10 client.15411 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:35.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c9e5b195f0 con 0x55c9e5738280 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f5322ff5640 1 -- 172.21.15.29:0/1194464193 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5338036040 con 0x55c9e5738280 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f5322ff5640 1 -- 172.21.15.29:0/1194464193 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5334018030 con 0x55c9e5738280 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 10 client.15411 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 20 client.15411 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e57178e0 0x55c9e5b1d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 4 client.15411 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 --> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9e5a78b60 con 0x55c9e57178e0 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.292+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e57178e0 0x55c9e5b1d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.293+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e57178e0 0x55c9e5b1d0b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78ba5a30c206e93f server_cookie=ab8478505ddeb5e5 in_seq=0 out_seq=0 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.293+0000 7f5322ff5640 10 client.15411 ms_handle_connect on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f5322ff5640 1 -- 172.21.15.29:0/1194464193 <== mds.1 v2:172.21.15.66:6838/3915731427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c9e5a78b60 con 0x55c9e57178e0 2024-09-21T07:09:35.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f5322ff5640 10 client.15411 handle_command_reply: tid=0 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 client.15411 shutdown 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5738280 msgr2=0x55c9e5b0af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5738280 0x55c9e5b0af50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f53340117e0 tx=0x7f5334011ca0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 shutdown_connections 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e57178e0 0x55c9e5b1d0b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5758f60 0x55c9e5b169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5738280 0x55c9e5b0af50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 --2- 172.21.15.29:0/1194464193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 >> 172.21.15.29:0/1194464193 conn(0x55c9e574d350 msgr2=0x55c9e5b020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f5322ff5640 0 client.15411 ms_handle_reset on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:35.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 shutdown_connections 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 1 -- 172.21.15.29:0/1194464193 wait complete. 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.294+0000 7f534ba07740 20 client.15411 trim_cache size 0 max 16384 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 Processor -- start 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 -- start start 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b1c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b1aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b09090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5b1b3f0 con 0x55c9e5758f60 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5b1bac0 con 0x55c9e57300a0 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.312+0000 7f534ba07740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5b1c190 con 0x55c9e5738280 2024-09-21T07:09:35.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b09090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b09090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34086/0 (socket says 172.21.15.29:34086) 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 -- 172.21.15.29:0/1292242828 learned_addr learned my addr 172.21.15.29:0/1292242828 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b1c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533e7fc640 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b1aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 -- 172.21.15.29:0/1292242828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 msgr2=0x55c9e5b1aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b1aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 -- 172.21.15.29:0/1292242828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 msgr2=0x55c9e5b1c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b1c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 -- 172.21.15.29:0/1292242828 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9e5af7080 con 0x55c9e5758f60 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f533f7fe640 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b09090 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f533802ade0 tx=0x7f5338005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cbe2292dac0976 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f5324ff9640 1 -- 172.21.15.29:0/1292242828 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533805a030 con 0x55c9e5758f60 2024-09-21T07:09:35.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f5324ff9640 1 -- 172.21.15.29:0/1292242828 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5338036070 con 0x55c9e5758f60 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.313+0000 7f5324ff9640 1 -- 172.21.15.29:0/1292242828 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338004620 con 0x55c9e5758f60 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 -- 172.21.15.29:0/1292242828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 msgr2=0x55c9e5b09090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b09090 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f533802ade0 tx=0x7f5338005c30 comp rx=0 tx=0).stop 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 -- 172.21.15.29:0/1292242828 shutdown_connections 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b09090 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b1aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 --2- 172.21.15.29:0/1292242828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b1c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 -- 172.21.15.29:0/1292242828 >> 172.21.15.29:0/1292242828 conn(0x55c9e574d350 msgr2=0x55c9e5b059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 -- 172.21.15.29:0/1292242828 shutdown_connections 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.314+0000 7f534ba07740 1 -- 172.21.15.29:0/1292242828 wait complete. 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 -- start start 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 Processor -- start 2024-09-21T07:09:35.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b0c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b23ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5b1cf30 con 0x55c9e5758f60 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5b1c860 con 0x55c9e57300a0 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c9e5b1d600 con 0x55c9e5738280 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f534ba07740 10 client.0 _ll_register_callbacks cb 0x7f5334011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f533f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b23ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f533f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b23ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34092/0 (socket says 172.21.15.29:34092) 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f533f7fe640 1 -- 172.21.15.29:0/3922779166 learned_addr learned my addr 172.21.15.29:0/3922779166 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f533e7fc640 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b0c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.315+0000 7f533f7fe640 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f533f7fe640 1 -- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 msgr2=0x55c9e5b0c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f533f7fe640 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b0c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f533f7fe640 1 -- 172.21.15.29:0/3922779166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 msgr2=0x55c9e5b0bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f533f7fe640 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f533f7fe640 1 -- 172.21.15.29:0/3922779166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9e5b24630 con 0x55c9e5758f60 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f533f7fe640 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b23ff0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f533802f470 tx=0x7f5338003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e6fd2ab65292d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f5322ff5640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f5322ff5640 1 -- 172.21.15.29:0/3922779166 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533805a040 con 0x55c9e5758f60 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f5322ff5640 1 -- 172.21.15.29:0/3922779166 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f5338004180 con 0x55c9e5758f60 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5338036070 con 0x55c9e5758f60 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f5322ff5640 1 -- 172.21.15.29:0/3922779166 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5338004380 con 0x55c9e5758f60 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f534ba07740 10 client.15417 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c9e5b25a10 con 0x55c9e5758f60 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.316+0000 7f5322ff5640 1 -- 172.21.15.29:0/3922779166 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5338036070 con 0x55c9e5758f60 2024-09-21T07:09:35.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f5322ff5640 1 -- 172.21.15.29:0/3922779166 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f53380305c0 con 0x55c9e5758f60 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f534ba07740 10 client.15417 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f534ba07740 10 client.15417 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f534ba07740 20 client.15417 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f534ba07740 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e56ecc90 0x55c9e5b8afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f534ba07740 4 client.15417 mds_command: new command op to 24655 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 --> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] -- command(tid 0: {"prefix": "status"}) -- 0x55c9e5a74610 con 0x55c9e56ecc90 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f533e7fc640 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e56ecc90 0x55c9e5b8afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f533e7fc640 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e56ecc90 0x55c9e5b8afc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfc22e636be1b8dc server_cookie=da23bedad902ac8d in_seq=0 out_seq=0 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.317+0000 7f5322ff5640 10 client.15417 ms_handle_connect on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f5322ff5640 1 -- 172.21.15.29:0/3922779166 <== mds.1 v2:172.21.15.66:6838/3915731427 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c9e5a74610 con 0x55c9e56ecc90 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f5322ff5640 10 client.15417 handle_command_reply: tid=0 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 client.15417 shutdown 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 msgr2=0x55c9e5b23ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b23ff0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f533802f470 tx=0x7f5338003d40 comp rx=0 tx=0).stop 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 shutdown_connections 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:6838/3915731427,v1:172.21.15.66:6839/3915731427] conn(0x55c9e56ecc90 0x55c9e5b8afc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55c9e5758f60 0x55c9e5b23ff0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c9e5738280 0x55c9e5b0c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 --2- 172.21.15.29:0/3922779166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9e57300a0 0x55c9e5b0bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 >> 172.21.15.29:0/3922779166 conn(0x55c9e574d350 msgr2=0x55c9e5b0a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f5322ff5640 0 client.15417 ms_handle_reset on v2:172.21.15.66:6838/3915731427 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 shutdown_connections 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 1 -- 172.21.15.29:0/3922779166 wait complete. 2024-09-21T07:09:35.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f534ba07740 20 client.15417 trim_cache size 0 max 16384 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 1, 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24655, 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:35.338 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 114.72355732600001, 2024-09-21T07:09:35.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:35.339 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:35.339 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:35.339 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 141.31236839900001 2024-09-21T07:09:35.339 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:35.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f53280b6540 msgr2=0x7f53280b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f5345493640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f53280b6540 0x7f53280b8a50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c9e5afdb80 tx=0x7f53300eb040 comp rx=0 tx=0).stop 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340102a60 msgr2=0x7f534019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.318+0000 7f5345493640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340102a60 0x7f534019a4d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f533000b4a0 tx=0x7f533000b960 comp rx=0 tx=0).stop 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 shutdown_connections 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f53280b6540 0x7f53280b8a50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5340108cf0 0x7f534019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53401083a0 0x7f534019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 --2- 172.21.15.29:0/3628402479 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5340102a60 0x7f534019a4d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 >> 172.21.15.29:0/3628402479 conn(0x7f5340079730 msgr2=0x7f53401052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 shutdown_connections 2024-09-21T07:09:35.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:35.319+0000 7f5345493640 1 -- 172.21.15.29:0/3628402479 wait complete. 2024-09-21T07:09:35.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:35 smithi052 ceph-mon[34308]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:35.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:35 smithi066 ceph-mon[34793]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:36.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T07:09:36.432 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.924+0000 7f77c7c17640 1 -- 172.21.15.29:0/430532927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c0102a80 msgr2=0x7f77c0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.924+0000 7f77c7c17640 1 --2- 172.21.15.29:0/430532927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c0102a80 0x7f77c0102e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009ca0 tx=0x7f77b002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.924+0000 7f77c7c17640 1 -- 172.21.15.29:0/430532927 shutdown_connections 2024-09-21T07:09:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.924+0000 7f77c7c17640 1 --2- 172.21.15.29:0/430532927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77c0108d10 0x7f77c010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.924+0000 7f77c7c17640 1 --2- 172.21.15.29:0/430532927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c01083c0 0x7f77c01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.924+0000 7f77c7c17640 1 --2- 172.21.15.29:0/430532927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c0102a80 0x7f77c0102e90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.924+0000 7f77c7c17640 1 -- 172.21.15.29:0/430532927 >> 172.21.15.29:0/430532927 conn(0x7f77c0079740 msgr2=0x7f77c0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.925+0000 7f77c7c17640 1 -- 172.21.15.29:0/430532927 shutdown_connections 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.925+0000 7f77c7c17640 1 -- 172.21.15.29:0/430532927 wait complete. 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.925+0000 7f77c7c17640 1 Processor -- start 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.925+0000 7f77c7c17640 1 -- start start 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c7c17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c0102a80 0x7f77c019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c7c17640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c01083c0 0x7f77c019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c7c17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77c0108d10 0x7f77c019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c7c17640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0112980 con 0x7f77c01083c0 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c7c17640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0112800 con 0x7f77c0108d10 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c7c17640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0112b00 con 0x7f77c0102a80 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c01083c0 0x7f77c019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c01083c0 0x7f77c019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34120/0 (socket says 172.21.15.29:34120) 2024-09-21T07:09:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 -- 172.21.15.29:0/1476021117 learned_addr learned my addr 172.21.15.29:0/1476021117 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c59b3640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c0102a80 0x7f77c019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c61b4640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77c0108d10 0x7f77c019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 -- 172.21.15.29:0/1476021117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c0102a80 msgr2=0x7f77c019b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c0102a80 0x7f77c019b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 -- 172.21.15.29:0/1476021117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77c0108d10 msgr2=0x7f77c019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77c0108d10 0x7f77c019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 -- 172.21.15.29:0/1476021117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c01a6560 con 0x7f77c01083c0 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c61b4640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77c0108d10 0x7f77c019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77c51b2640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c01083c0 0x7f77c019b790 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f77b400c970 tx=0x7f77b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.926+0000 7f77beffd640 1 -- 172.21.15.29:0/1476021117 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4007bb0 con 0x7f77c01083c0 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.927+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c01a6850 con 0x7f77c01083c0 2024-09-21T07:09:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.927+0000 7f77beffd640 1 -- 172.21.15.29:0/1476021117 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b4007d50 con 0x7f77c01083c0 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.927+0000 7f77beffd640 1 -- 172.21.15.29:0/1476021117 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4018730 con 0x7f77c01083c0 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.927+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01a6d90 con 0x7f77c01083c0 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 Processor -- start 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 -- start start 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a9ff60 0x55def1e45f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e46440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e46980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55def1dbdc10 con 0x55def1a7f280 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55def1dad040 con 0x55def1a9ff60 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77ce18b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55def1db0e50 con 0x55def1a770a0 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77beffd640 1 -- 172.21.15.29:0/1476021117 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f77b400f990 con 0x7f77c01083c0 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.930+0000 7f77c51b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e46980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c61b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a9ff60 0x55def1e45f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c59b3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e46440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c61b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a9ff60 0x55def1e45f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:55214/0 (socket says 172.21.15.29:55214) 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c61b4640 1 -- 172.21.15.29:0/2784317294 learned_addr learned my addr 172.21.15.29:0/2784317294 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c51b2640 1 -- 172.21.15.29:0/2784317294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 msgr2=0x55def1e46440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c51b2640 1 --2- 172.21.15.29:0/2784317294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e46440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c51b2640 1 -- 172.21.15.29:0/2784317294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a9ff60 msgr2=0x55def1e45f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c51b2640 1 --2- 172.21.15.29:0/2784317294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a9ff60 0x55def1e45f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c51b2640 1 -- 172.21.15.29:0/2784317294 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def1b0b540 con 0x55def1a7f280 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c51b2640 1 --2- 172.21.15.29:0/2784317294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e46980 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f77b40e4e70 tx=0x7f77b40ef9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1ae64deda13e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77beffd640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f77a80b6510 0x7f77a80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77a7fff640 1 -- 172.21.15.29:0/2784317294 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40fb070 con 0x55def1a7f280 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.931+0000 7f77c61b4640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f77a80b6510 0x7f77a80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.932+0000 7f77beffd640 1 -- 172.21.15.29:0/1476021117 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f77b40e7390 con 0x7f77c01083c0 2024-09-21T07:09:36.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.932+0000 7f77a7fff640 1 -- 172.21.15.29:0/2784317294 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b40ad040 con 0x55def1a7f280 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.932+0000 7f77a7fff640 1 -- 172.21.15.29:0/2784317294 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40a93d0 con 0x55def1a7f280 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 -- 172.21.15.29:0/2784317294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 msgr2=0x55def1e46980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77c61b4640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f77a80b6510 0x7f77a80b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f77b8005d00 tx=0x7f77b80094c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2784317294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e46980 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f77b40e4e70 tx=0x7f77b40ef9b0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 -- 172.21.15.29:0/2784317294 shutdown_connections 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2784317294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e46980 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2784317294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e46440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2784317294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a9ff60 0x55def1e45f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 -- 172.21.15.29:0/2784317294 >> 172.21.15.29:0/2784317294 conn(0x55def1a94350 msgr2=0x55def1e43df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 -- 172.21.15.29:0/2784317294 shutdown_connections 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 -- 172.21.15.29:0/2784317294 wait complete. 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 -- start start 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.933+0000 7f77ce18b740 1 Processor -- start 2024-09-21T07:09:36.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e51990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e51ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e5d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77ce18b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55def1c0e5f0 con 0x55def1a7f280 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77ce18b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55def1d48010 con 0x55def1a770a0 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77ce18b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55def1e546e0 con 0x55def1a9ff60 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77ce18b740 10 client.0 _ll_register_callbacks cb 0x55def1da7340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e51ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e51ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34140/0 (socket says 172.21.15.29:34140) 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 -- 172.21.15.29:0/7842119 learned_addr learned my addr 172.21.15.29:0/7842119 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c61b4640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e5d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c59b3640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e51990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 -- 172.21.15.29:0/7842119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 msgr2=0x55def1e5d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e5d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 -- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 msgr2=0x55def1e51990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e51990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c51b2640 1 -- 172.21.15.29:0/7842119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55def1d75a00 con 0x55def1a7f280 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.934+0000 7f77c59b3640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e51990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77c51b2640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e51ed0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f77b40e5210 tx=0x7f77b40076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aefb30251e5180a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77a57fa640 1 -- 172.21.15.29:0/7842119 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40acca0 con 0x55def1a7f280 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77a57fa640 1 -- 172.21.15.29:0/7842119 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f77b40b6cc0 con 0x55def1a7f280 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b40ad040 con 0x55def1a7f280 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77a57fa640 1 -- 172.21.15.29:0/7842119 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f77b40ace80 con 0x55def1a7f280 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 10 client.15429 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55def1e605d0 con 0x55def1a7f280 2024-09-21T07:09:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77a57fa640 1 -- 172.21.15.29:0/7842119 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b40ad040 con 0x55def1a7f280 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77a57fa640 1 -- 172.21.15.29:0/7842119 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f77b4020030 con 0x55def1a7f280 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 10 client.15429 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 20 client.15429 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a5e8e0 0x55def1e63a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 4 client.15429 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.935+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 --> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55def1dbfb60 con 0x55def1a5e8e0 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.936+0000 7f77c59b3640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a5e8e0 0x55def1e63a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.936+0000 7f77a57fa640 10 client.15429 ms_handle_connect on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.936+0000 7f77c59b3640 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a5e8e0 0x55def1e63a80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=573baf74c20b7a4 server_cookie=e0b7840d5da28b65 in_seq=0 out_seq=0 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77a57fa640 1 -- 172.21.15.29:0/7842119 <== mds.0 v2:172.21.15.52:6838/1429145114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55def1dbfb60 con 0x55def1a5e8e0 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77a57fa640 10 client.15429 handle_command_reply: tid=0 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 client.15429 shutdown 2024-09-21T07:09:36.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 msgr2=0x55def1e51ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e51ed0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f77b40e5210 tx=0x7f77b40076c0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 shutdown_connections 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a5e8e0 0x55def1e63a80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e5d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e51ed0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 --2- 172.21.15.29:0/7842119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e51990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77a57fa640 0 client.15429 ms_handle_reset on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 >> 172.21.15.29:0/7842119 conn(0x55def1a94350 msgr2=0x55def1e490e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 shutdown_connections 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 1 -- 172.21.15.29:0/7842119 wait complete. 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.937+0000 7f77ce18b740 20 client.15429 trim_cache size 0 max 16384 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 Processor -- start 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 -- start start 2024-09-21T07:09:36.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e4beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a7f280 0x55def1e509c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a9ff60 0x55def1e5d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55def1e61dc0 con 0x55def1a9ff60 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55def1e62490 con 0x55def1a7f280 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77ce18b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55def1e62b60 con 0x55def1a770a0 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a9ff60 0x55def1e5d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a9ff60 0x55def1e5d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34142/0 (socket says 172.21.15.29:34142) 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 -- 172.21.15.29:0/2786646885 learned_addr learned my addr 172.21.15.29:0/2786646885 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c59b3640 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e4beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c51b2640 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a7f280 0x55def1e509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 -- 172.21.15.29:0/2786646885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 msgr2=0x55def1e4beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e4beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 -- 172.21.15.29:0/2786646885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a7f280 msgr2=0x55def1e509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a7f280 0x55def1e509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.956+0000 7f77c61b4640 1 -- 172.21.15.29:0/2786646885 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55def1e4c3f0 con 0x55def1a9ff60 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.957+0000 7f77c61b4640 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a9ff60 0x55def1e5d940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f77b80124a0 tx=0x7f77b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c067593e831186 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.957+0000 7f77a77fe640 1 -- 172.21.15.29:0/2786646885 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8029670 con 0x55def1a9ff60 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.957+0000 7f77a77fe640 1 -- 172.21.15.29:0/2786646885 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b8024070 con 0x55def1a9ff60 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.957+0000 7f77a77fe640 1 -- 172.21.15.29:0/2786646885 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8020c60 con 0x55def1a9ff60 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 -- 172.21.15.29:0/2786646885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a9ff60 msgr2=0x55def1e5d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a9ff60 0x55def1e5d940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f77b80124a0 tx=0x7f77b8014000 comp rx=0 tx=0).stop 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 -- 172.21.15.29:0/2786646885 shutdown_connections 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a9ff60 0x55def1e5d940 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a7f280 0x55def1e509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 --2- 172.21.15.29:0/2786646885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a770a0 0x55def1e4beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 -- 172.21.15.29:0/2786646885 >> 172.21.15.29:0/2786646885 conn(0x55def1a94350 msgr2=0x55def1e4c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:36.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 -- 172.21.15.29:0/2786646885 shutdown_connections 2024-09-21T07:09:36.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 -- 172.21.15.29:0/2786646885 wait complete. 2024-09-21T07:09:36.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 -- start start 2024-09-21T07:09:36.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.958+0000 7f77ce18b740 1 Processor -- start 2024-09-21T07:09:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e6c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e4e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77ce18b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e4ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77ce18b740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55def1e63900 con 0x55def1a7f280 2024-09-21T07:09:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77ce18b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55def1e63230 con 0x55def1a770a0 2024-09-21T07:09:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77ce18b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55def1e63fd0 con 0x55def1a9ff60 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77ce18b740 10 client.0 _ll_register_callbacks cb 0x7f77b40f9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e4e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e4e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34144/0 (socket says 172.21.15.29:34144) 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 -- 172.21.15.29:0/3877788952 learned_addr learned my addr 172.21.15.29:0/3877788952 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c61b4640 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e4ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c59b3640 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e6c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 -- 172.21.15.29:0/3877788952 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 msgr2=0x55def1e4ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e4ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 -- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 msgr2=0x55def1e6c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e6c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 -- 172.21.15.29:0/3877788952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55def1e4f590 con 0x55def1a7f280 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77c51b2640 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e4e860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f77b40b2060 tx=0x7f77b40ef9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b1a76d9a08ca99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.959+0000 7f77a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77a57fa640 1 -- 172.21.15.29:0/3877788952 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40ad300 con 0x55def1a7f280 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77a57fa640 1 -- 172.21.15.29:0/3877788952 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f77b40ac790 con 0x55def1a7f280 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b8024070 con 0x55def1a7f280 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77a57fa640 1 -- 172.21.15.29:0/3877788952 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f77b40acca0 con 0x55def1a7f280 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 10 client.15435 fetch_fsmap learned FSMap version 27 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55def1ecef50 con 0x55def1a7f280 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77a57fa640 1 -- 172.21.15.29:0/3877788952 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77b8024070 con 0x55def1a7f280 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77a57fa640 1 -- 172.21.15.29:0/3877788952 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f77b4020040 con 0x55def1a7f280 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 10 client.15435 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 20 client.15435 populate_metadata read hostname 'smithi029' 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a33c90 0x55def1ed2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 4 client.15435 mds_command: new command op to 24692 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.960+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 --> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] -- command(tid 0: {"prefix": "status"}) -- 0x55def1dbb610 con 0x55def1a33c90 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.961+0000 7f77c59b3640 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a33c90 0x55def1ed2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.961+0000 7f77a57fa640 10 client.15435 ms_handle_connect on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.961+0000 7f77c59b3640 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a33c90 0x55def1ed2530 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e3ffc985cc36b0a server_cookie=4b50fa8db5a02941 in_seq=0 out_seq=0 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.961+0000 7f77a57fa640 1 -- 172.21.15.29:0/3877788952 <== mds.0 v2:172.21.15.52:6838/1429145114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55def1dbb610 con 0x55def1a33c90 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.961+0000 7f77a57fa640 10 client.15435 handle_command_reply: tid=0 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 client.15435 shutdown 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 msgr2=0x55def1e4e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e4e860 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f77b40b2060 tx=0x7f77b40ef9b0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 shutdown_connections 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:6838/1429145114,v1:172.21.15.52:6839/1429145114] conn(0x55def1a33c90 0x55def1ed2530 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55def1a9ff60 0x55def1e4ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55def1a7f280 0x55def1e4e860 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 --2- 172.21.15.29:0/3877788952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55def1a770a0 0x55def1e6c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77a57fa640 0 client.15435 ms_handle_reset on v2:172.21.15.52:6838/1429145114 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 >> 172.21.15.29:0/3877788952 conn(0x55def1a94350 msgr2=0x55def1e43600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 shutdown_connections 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 1 -- 172.21.15.29:0/3877788952 wait complete. 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77ce18b740 20 client.15435 trim_cache size 0 max 16384 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "d3a42dd8-77e6-11ef-baf5-efdc52797490", 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-09-21T07:09:36.979 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24692, 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 123.399242582, 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 27, 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 75, 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 73, 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 133.085476726 2024-09-21T07:09:36.980 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f77a80b6510 msgr2=0x7f77a80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77c7c17640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f77a80b6510 0x7f77a80b8a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f77b8005d00 tx=0x7f77b80094c0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c01083c0 msgr2=0x7f77c019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.962+0000 7f77c7c17640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c01083c0 0x7f77c019b790 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f77b400c970 tx=0x7f77b400ce30 comp rx=0 tx=0).stop 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 shutdown_connections 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f77a80b6510 0x7f77a80b8a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77c0108d10 0x7f77c019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77c01083c0 0x7f77c019b790 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 --2- 172.21.15.29:0/1476021117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c0102a80 0x7f77c019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:36.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 >> 172.21.15.29:0/1476021117 conn(0x7f77c0079740 msgr2=0x7f77c0101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:36.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 shutdown_connections 2024-09-21T07:09:36.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:36.963+0000 7f77c7c17640 1 -- 172.21.15.29:0/1476021117 wait complete. 2024-09-21T07:09:37.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:37 smithi052 ceph-mon[34308]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:37.580 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:37 smithi029 ceph-mon[30983]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:37.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:37 smithi066 ceph-mon[34793]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:09:37.673 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T07:09:37.696 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T07:09:37.696 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T07:09:37.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:37.696 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-21T07:09:37.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:37.714 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-09-21T07:09:37.783 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2024-09-21T07:09:37.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:09:37.785 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T07:09:37.785 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:09:37.785 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:37.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T07:09:38.081 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:09:38.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 -- 172.21.15.29:0/1572828063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c108cf0 msgr2=0x7fc88c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:38.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 --2- 172.21.15.29:0/1572828063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c108cf0 0x7fc88c10f520 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc884009ca0 tx=0x7fc88402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 -- 172.21.15.29:0/1572828063 shutdown_connections 2024-09-21T07:09:38.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 --2- 172.21.15.29:0/1572828063 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c108cf0 0x7fc88c10f520 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 --2- 172.21.15.29:0/1572828063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1083a0 0x7fc88c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 --2- 172.21.15.29:0/1572828063 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc88c102a60 0x7fc88c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 -- 172.21.15.29:0/1572828063 >> 172.21.15.29:0/1572828063 conn(0x7fc88c079730 msgr2=0x7fc88c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:38.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 -- 172.21.15.29:0/1572828063 shutdown_connections 2024-09-21T07:09:38.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.592+0000 7fc892ac7640 1 -- 172.21.15.29:0/1572828063 wait complete. 2024-09-21T07:09:38.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 Processor -- start 2024-09-21T07:09:38.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 -- start start 2024-09-21T07:09:38.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c102a60 0x7fc88c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1083a0 0x7fc88c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc88c108cf0 0x7fc88c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c112960 con 0x7fc88c102a60 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1127e0 con 0x7fc88c1083a0 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc892ac7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c112ae0 con 0x7fc88c108cf0 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc890863640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c102a60 0x7fc88c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc890863640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c102a60 0x7fc88c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43716/0 (socket says 172.21.15.29:43716) 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc890863640 1 -- 172.21.15.29:0/3842480412 learned_addr learned my addr 172.21.15.29:0/3842480412 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc891064640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc88c108cf0 0x7fc88c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.593+0000 7fc88bfff640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1083a0 0x7fc88c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc890863640 1 -- 172.21.15.29:0/3842480412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc88c108cf0 msgr2=0x7fc88c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc890863640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc88c108cf0 0x7fc88c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc890863640 1 -- 172.21.15.29:0/3842480412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1083a0 msgr2=0x7fc88c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc890863640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1083a0 0x7fc88c19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc890863640 1 -- 172.21.15.29:0/3842480412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c1a0430 con 0x7fc88c102a60 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc890863640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c102a60 0x7fc88c19a4c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc88000d950 tx=0x7fc88000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc889ffb640 1 -- 172.21.15.29:0/3842480412 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880017030 con 0x7fc88c102a60 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c1a0720 con 0x7fc88c102a60 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc889ffb640 1 -- 172.21.15.29:0/3842480412 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc880004020 con 0x7fc88c102a60 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc889ffb640 1 -- 172.21.15.29:0/3842480412 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8800047a0 con 0x7fc88c102a60 2024-09-21T07:09:38.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.594+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c1a6e80 con 0x7fc88c102a60 2024-09-21T07:09:38.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.595+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c102e70 con 0x7fc88c102a60 2024-09-21T07:09:38.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.597+0000 7fc889ffb640 1 -- 172.21.15.29:0/3842480412 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc880009a30 con 0x7fc88c102a60 2024-09-21T07:09:38.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.597+0000 7fc889ffb640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc87c0b6510 0x7fc87c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:38.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.598+0000 7fc88bfff640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc87c0b6510 0x7fc87c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:38.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.598+0000 7fc889ffb640 1 -- 172.21.15.29:0/3842480412 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc8800e6d30 con 0x7fc88c102a60 2024-09-21T07:09:38.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.598+0000 7fc88bfff640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc87c0b6510 0x7fc87c0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc878005e00 tx=0x7fc878005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:38.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.602+0000 7fc889ffb640 1 -- 172.21.15.29:0/3842480412 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8800ad5d0 con 0x7fc88c102a60 2024-09-21T07:09:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.831+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc88c10b540 con 0x7fc88c102a60 2024-09-21T07:09:38.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.831+0000 7fc889ffb640 1 -- 172.21.15.29:0/3842480412 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fc8800b19b0 con 0x7fc88c102a60 2024-09-21T07:09:38.833 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:09:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc87c0b6510 msgr2=0x7fc87c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc87c0b6510 0x7fc87c0b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc878005e00 tx=0x7fc878005c50 comp rx=0 tx=0).stop 2024-09-21T07:09:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c102a60 msgr2=0x7fc88c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c102a60 0x7fc88c19a4c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc88000d950 tx=0x7fc88000de10 comp rx=0 tx=0).stop 2024-09-21T07:09:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 shutdown_connections 2024-09-21T07:09:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc87c0b6510 0x7fc87c0b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc88c108cf0 0x7fc88c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1083a0 0x7fc88c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 --2- 172.21.15.29:0/3842480412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc88c102a60 0x7fc88c19a4c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.834+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 >> 172.21.15.29:0/3842480412 conn(0x7fc88c079730 msgr2=0x7fc88c06b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.835+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 shutdown_connections 2024-09-21T07:09:38.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:38.835+0000 7fc892ac7640 1 -- 172.21.15.29:0/3842480412 wait complete. 2024-09-21T07:09:39.403 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:39 smithi066 ceph-mon[34793]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:39.404 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:39 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3842480412' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:09:39.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:39 smithi029 ceph-mon[30983]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:39.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:39 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3842480412' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:09:39.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:39 smithi052 ceph-mon[34308]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:09:39.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:39 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3842480412' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:09:39.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:09:39.510 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:09:39.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:39.510 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-09-21T07:09:39.528 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:09:39.528 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:09:39.528 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:09:39.528 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:09:39.528 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-09-21T07:09:39.528 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:09:39.528 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42102sec preferred_lft 42102sec 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:09:39.529 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-09-21T07:09:39.530 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-09-21T07:09:39.530 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:09:39.530 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:09:39.530 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-21T07:09:39.530 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:09:39.530 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-09-21T07:09:39.530 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-09-21T07:09:39.530 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:09:39.531 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-21T07:09:39.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:09:39.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:39.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:39.751 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:09:39.776 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-09-21T07:09:39.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:39.778 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-09-21T07:09:39.845 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-09-21T07:09:39.845 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:09:39.846 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T07:09:39.846 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T07:09:39.846 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:09:39.846 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:09:39.846 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-21T07:09:39.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T07:09:39.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T07:09:39.846 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T07:09:39.846 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-21T07:09:39.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:09:40.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:40.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:40.176 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-21T07:09:40.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:40.192 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-09-21T07:09:40.248 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:09:40.248 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-21T07:09:40.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:09:40.248 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:09:40.248 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-21T07:09:40.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:09:40.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:40.368 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:09:40.369 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-21T07:09:40.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:09:40.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:40.503 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:09:40.503 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-21T07:09:40.503 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-09-21T07:09:40.503 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:09:40.503 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-21T07:09:40.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:09:40.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:40.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:09:40.584 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:40.600 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:09:40.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:09:40.601 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:40.657 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T07:09:40.657 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T07:09:40.657 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/baddd009-7e27-443d-b0ae-50678aacb90d 2024-09-21T07:09:40.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:40.658 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/baddd009-7e27-443d-b0ae-50678aacb90d /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T07:09:40.768 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T07:09:40.768 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-21T07:09:40.895 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-21T07:09:40.895 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-21T07:09:40.896 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.29:3300,172.21.15.52:3300,172.21.15.66:3300" 2024-09-21T07:09:40.896 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 0@d3a42dd8-77e6-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/baddd009-7e27-443d-b0ae-50678aacb90d 2024-09-21T07:09:40.896 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.29:3300/172.21.15.52:3300/172.21.15.66:3300" will pass to kernel 2024-09-21T07:09:40.896 INFO:teuthology.orchestra.run.smithi029.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:09:40.896 INFO:teuthology.orchestra.run.smithi029.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:09:40.897 INFO:teuthology.orchestra.run.smithi029.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:09:40.897 INFO:teuthology.orchestra.run.smithi029.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:09:40.897 INFO:teuthology.orchestra.run.smithi029.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:09:40.898 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:09:40.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:09:40.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:40.930 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:09:41.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:09:41.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:41.028 INFO:teuthology.orchestra.run.smithi029.stdout:client15444 2024-09-21T07:09:41.028 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:09:41.028 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:09:41.045 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:09:41.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:09:41.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:41.144 INFO:teuthology.orchestra.run.smithi029.stdout:client15444 2024-09-21T07:09:41.144 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:09:41.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:09:41.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:41.202 INFO:teuthology.orchestra.run.smithi029.stdout:client15444 2024-09-21T07:09:41.202 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490.client15444/status') 2024-09-21T07:09:41.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:09:41.262 INFO:teuthology.orchestra.run.smithi029.stdout:instance: client.15444 (3)192.168.0.1:0/2282219191 2024-09-21T07:09:41.262 INFO:teuthology.orchestra.run.smithi029.stdout:blocklisted: false 2024-09-21T07:09:41.262 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records in 2024-09-21T07:09:41.262 INFO:teuthology.orchestra.run.smithi029.stderr:0+1 records out 2024-09-21T07:09:41.262 INFO:teuthology.orchestra.run.smithi029.stderr:70 bytes copied, 2.4409e-05 s, 2.9 MB/s 2024-09-21T07:09:41.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:09:41.269 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T07:09:41.279 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T07:09:41.279 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T07:09:41.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T07:09:41.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 -- 172.21.15.29:0/4287865250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 msgr2=0x7f78f810a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 --2- 172.21.15.29:0/4287865250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f810a980 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009ca0 tx=0x7f78f002a8c0 comp rx=0 tx=0).stop 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 -- 172.21.15.29:0/4287865250 shutdown_connections 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 --2- 172.21.15.29:0/4287865250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f810a980 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 --2- 172.21.15.29:0/4287865250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f8103640 0x7f78f8103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 --2- 172.21.15.29:0/4287865250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f81025c0 0x7f78f8102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 -- 172.21.15.29:0/4287865250 >> 172.21.15.29:0/4287865250 conn(0x7f78f80fdf00 msgr2=0x7f78f81003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 -- 172.21.15.29:0/4287865250 shutdown_connections 2024-09-21T07:09:41.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.393+0000 7f78fee8b640 1 -- 172.21.15.29:0/4287865250 wait complete. 2024-09-21T07:09:41.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 Processor -- start 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 -- start start 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f81025c0 0x7f78f81061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f8103640 0x7f78f8104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f8104fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810e1f0 con 0x7f78f8103fe0 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810e070 con 0x7f78f81025c0 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fee8b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810e370 con 0x7f78f8103640 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f8104fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f8104fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:43724/0 (socket says 172.21.15.29:43724) 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 -- 172.21.15.29:0/3672828666 learned_addr learned my addr 172.21.15.29:0/3672828666 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fcc27640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f81025c0 0x7f78f81061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78f7fff640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f8103640 0x7f78f8104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:41.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 -- 172.21.15.29:0/3672828666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f8103640 msgr2=0x7f78f8104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f8103640 0x7f78f8104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 -- 172.21.15.29:0/3672828666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f81025c0 msgr2=0x7f78f81061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f81025c0 0x7f78f81061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.394+0000 7f78fd428640 1 -- 172.21.15.29:0/3672828666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f81056e0 con 0x7f78f8103fe0 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.395+0000 7f78fd428640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f8104fb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f78f00097b0 tx=0x7f78f0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.395+0000 7f78f5ffb640 1 -- 172.21.15.29:0/3672828666 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0004240 con 0x7f78f8103fe0 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.395+0000 7f78f5ffb640 1 -- 172.21.15.29:0/3672828666 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f00317c0 con 0x7f78f8103fe0 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.395+0000 7f78f5ffb640 1 -- 172.21.15.29:0/3672828666 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f002fc30 con 0x7f78f8103fe0 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.395+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f81a3f80 con 0x7f78f8103fe0 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.395+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f81a4330 con 0x7f78f8103fe0 2024-09-21T07:09:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.396+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f81a4560 con 0x7f78f8103fe0 2024-09-21T07:09:41.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.398+0000 7f78f5ffb640 1 -- 172.21.15.29:0/3672828666 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f78f00043e0 con 0x7f78f8103fe0 2024-09-21T07:09:41.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.398+0000 7f78f5ffb640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f78e00b6510 0x7f78e00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:09:41.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.399+0000 7f78f5ffb640 1 -- 172.21.15.29:0/3672828666 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f78f0108940 con 0x7f78f8103fe0 2024-09-21T07:09:41.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.399+0000 7f78fcc27640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f78e00b6510 0x7f78e00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:09:41.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.399+0000 7f78fcc27640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f78e00b6510 0x7f78e00b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78e800bbe0 tx=0x7f78e800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:09:41.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.402+0000 7f78f5ffb640 1 -- 172.21.15.29:0/3672828666 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78f00cf1e0 con 0x7f78f8103fe0 2024-09-21T07:09:41.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:41 smithi052 ceph-mon[34308]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:41.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:41 smithi066 ceph-mon[34793]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:41.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:41 smithi029 ceph-mon[30983]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:09:41.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:41.631+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f78f81a4950 con 0x7f78f8103fe0 2024-09-21T07:09:42.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.153+0000 7f78f5ffb640 1 -- 172.21.15.29:0/3672828666 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f78f00d35c0 con 0x7f78f8103fe0 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f78e00b6510 msgr2=0x7f78e00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f78e00b6510 0x7f78e00b8a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f78e800bbe0 tx=0x7f78e800b390 comp rx=0 tx=0).stop 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 msgr2=0x7f78f8104fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f8104fb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f78f00097b0 tx=0x7f78f0003c20 comp rx=0 tx=0).stop 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 shutdown_connections 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f78e00b6510 0x7f78e00b8a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78f8103fe0 0x7f78f8104fb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f8103640 0x7f78f8104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 --2- 172.21.15.29:0/3672828666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f78f81025c0 0x7f78f81061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:09:42.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 >> 172.21.15.29:0/3672828666 conn(0x7f78f80fdf00 msgr2=0x7f78f806ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:09:42.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 shutdown_connections 2024-09-21T07:09:42.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:09:42.156+0000 7f78fee8b640 1 -- 172.21.15.29:0/3672828666 wait complete. 2024-09-21T07:09:42.171 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T07:09:42.187 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T07:09:42.228 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:09:42.228 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T07:09:42.228 INFO:tasks.workunit:timeout=3h 2024-09-21T07:09:42.228 INFO:tasks.workunit:cleanup=True 2024-09-21T07:09:42.229 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:42.246 INFO:teuthology.orchestra.run.smithi029.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:42.246 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T07:09:42.247 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 54h/84d Inode: 1099511628283 Links: 2 2024-09-21T07:09:42.247 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T07:09:42.247 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T07:09:42.247 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-21 07:07:51.486584711 +0000 2024-09-21T07:09:42.247 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-21 07:07:51.486584711 +0000 2024-09-21T07:09:42.247 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-21 07:09:40.921217092 +0000 2024-09-21T07:09:42.247 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-21 07:07:51.486584711 +0000 2024-09-21T07:09:42.247 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T07:09:42.247 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T07:09:42.325 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T07:09:42.383 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T07:09:42.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:42 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3672828666' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T07:09:42.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:42 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3672828666' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T07:09:42.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:42 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3672828666' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T07:09:43.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:43 smithi052 ceph-mon[34308]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:43.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:43 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3672828666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T07:09:43.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:43 smithi052 ceph-mon[34308]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:09:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:43 smithi066 ceph-mon[34793]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:43 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3672828666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T07:09:43.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:43 smithi066 ceph-mon[34793]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:09:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:43 smithi029 ceph-mon[30983]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:09:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:43 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3672828666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T07:09:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:43 smithi029 ceph-mon[30983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:09:45.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:45 smithi052 ceph-mon[34308]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T07:09:45.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:45 smithi066 ceph-mon[34793]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T07:09:45.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:45 smithi029 ceph-mon[30983]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T07:09:47.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:47 smithi052 ceph-mon[34308]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T07:09:47.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:47 smithi066 ceph-mon[34793]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T07:09:47.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:47 smithi029 ceph-mon[30983]: pgmap v360: 97 pgs: 97 active+clean; 658 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-21T07:09:49.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:49 smithi052 ceph-mon[34308]: pgmap v361: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:49.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:49 smithi066 ceph-mon[34793]: pgmap v361: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:49 smithi029 ceph-mon[30983]: pgmap v361: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:51 smithi052 ceph-mon[34308]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:51.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:51 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:51.570 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:51 smithi066 ceph-mon[34793]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:51.570 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:51 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:51.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:51 smithi029 ceph-mon[30983]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:51.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:51 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:09:52.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:52.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:52 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:52.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:52 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:52.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:52.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:52 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:53.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:53.745 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:53.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:53.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-21T07:09:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:53.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:09:53.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:09:53.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:09:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:55 smithi052 ceph-mon[34308]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T07:09:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:55 smithi066 ceph-mon[34793]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T07:09:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:55 smithi029 ceph-mon[30983]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-21T07:09:57.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:57 smithi052 ceph-mon[34308]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T07:09:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:57 smithi066 ceph-mon[34793]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T07:09:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:57 smithi029 ceph-mon[30983]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T07:09:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:09:59 smithi052 ceph-mon[34308]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:09:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:09:59 smithi066 ceph-mon[34793]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:09:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:09:59 smithi029 ceph-mon[30983]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:10:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:00 smithi052 ceph-mon[34308]: overall HEALTH_OK 2024-09-21T07:10:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:00 smithi066 ceph-mon[34793]: overall HEALTH_OK 2024-09-21T07:10:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:00 smithi029 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T07:10:01.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:01 smithi052 ceph-mon[34308]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:01.771 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:01 smithi029 ceph-mon[30983]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:01 smithi066 ceph-mon[34793]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:03.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:03 smithi052 ceph-mon[34308]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:03 smithi066 ceph-mon[34793]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:03 smithi029 ceph-mon[30983]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:05.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:05 smithi052 ceph-mon[34308]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:05.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:05 smithi066 ceph-mon[34793]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:05.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:05 smithi029 ceph-mon[30983]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:07 smithi052 ceph-mon[34308]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:07.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:07 smithi066 ceph-mon[34793]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:07 smithi029 ceph-mon[30983]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:09.669 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:09 smithi066 ceph-mon[34793]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:10:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:09 smithi052 ceph-mon[34308]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:10:09.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:09 smithi029 ceph-mon[30983]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:10:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:11 smithi052 ceph-mon[34308]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:11.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:11 smithi066 ceph-mon[34793]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:11 smithi029 ceph-mon[30983]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:13.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:13 smithi052 ceph-mon[34308]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:13.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:13 smithi066 ceph-mon[34793]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:13.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:13 smithi029 ceph-mon[30983]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:15.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:15 smithi052 ceph-mon[34308]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:15.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:15 smithi066 ceph-mon[34793]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:15.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:15 smithi029 ceph-mon[30983]: pgmap v374: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:17 smithi052 ceph-mon[34308]: pgmap v375: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:17 smithi066 ceph-mon[34793]: pgmap v375: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:17.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:17 smithi029 ceph-mon[30983]: pgmap v375: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:19.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:19 smithi052 ceph-mon[34308]: pgmap v376: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:10:19.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:19 smithi066 ceph-mon[34793]: pgmap v376: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:10:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:19 smithi029 ceph-mon[30983]: pgmap v376: 97 pgs: 97 active+clean; 659 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-21T07:10:21.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:21 smithi052 ceph-mon[34308]: pgmap v377: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:21.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:21 smithi066 ceph-mon[34793]: pgmap v377: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:21 smithi029 ceph-mon[30983]: pgmap v377: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:23 smithi052 ceph-mon[34308]: pgmap v378: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:23 smithi066 ceph-mon[34793]: pgmap v378: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:23.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:23 smithi029 ceph-mon[30983]: pgmap v378: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:25 smithi052 ceph-mon[34308]: pgmap v379: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T07:10:25.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:25 smithi066 ceph-mon[34793]: pgmap v379: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T07:10:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:25 smithi029 ceph-mon[30983]: pgmap v379: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-21T07:10:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:27 smithi052 ceph-mon[34308]: pgmap v380: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:10:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:27 smithi066 ceph-mon[34793]: pgmap v380: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:10:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:27 smithi029 ceph-mon[30983]: pgmap v380: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-21T07:10:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:29 smithi052 ceph-mon[34308]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:29 smithi066 ceph-mon[34793]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:29 smithi029 ceph-mon[30983]: pgmap v381: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-21T07:10:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:31 smithi052 ceph-mon[34308]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:10:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:31 smithi066 ceph-mon[34793]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:10:31.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:31 smithi029 ceph-mon[30983]: pgmap v382: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T07:10:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:33 smithi052 ceph-mon[34308]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:33 smithi066 ceph-mon[34793]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:33 smithi029 ceph-mon[30983]: pgmap v383: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:35 smithi052 ceph-mon[34308]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:35 smithi066 ceph-mon[34793]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:35 smithi029 ceph-mon[30983]: pgmap v384: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:37 smithi052 ceph-mon[34308]: pgmap v385: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:37 smithi066 ceph-mon[34793]: pgmap v385: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:37 smithi029 ceph-mon[30983]: pgmap v385: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:39.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:39 smithi052 ceph-mon[34308]: pgmap v386: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:10:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:39 smithi066 ceph-mon[34793]: pgmap v386: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:10:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:39 smithi029 ceph-mon[30983]: pgmap v386: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T07:10:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:41 smithi052 ceph-mon[34308]: pgmap v387: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:41 smithi066 ceph-mon[34793]: pgmap v387: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:41 smithi029 ceph-mon[30983]: pgmap v387: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-21T07:10:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:43 smithi052 ceph-mon[34308]: pgmap v388: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:43.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:43 smithi066 ceph-mon[34793]: pgmap v388: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:43 smithi029 ceph-mon[30983]: pgmap v388: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T07:10:44.056 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 93% (11840/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T07:10:44.423 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T07:10:44.423 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:44.423 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T07:10:44.423 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:44.424 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T07:10:44.428 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T07:10:44.495 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T07:10:44.497 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:10:44.497 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T07:10:45.572 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T07:10:45.682 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T07:10:45.725 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T07:10:45.727 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:10:45.727 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T07:10:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:45 smithi052 ceph-mon[34308]: pgmap v389: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:10:45.768 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T07:10:45.772 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:10:45.772 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T07:10:45.829 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-21T07:10:45.831 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-21T07:10:45.831 DEBUG:teuthology.orchestra.run.smithi029:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-21T07:10:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:45 smithi066 ceph-mon[34793]: pgmap v389: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:10:45.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:45 smithi029 ceph-mon[30983]: pgmap v389: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T07:10:45.892 INFO:tasks.workunit.client.0.smithi029.stdout:getting iogen 2024-09-21T07:10:45.892 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'getting iogen' 2024-09-21T07:10:45.892 INFO:tasks.workunit.client.0.smithi029.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-21T07:10:45.920 INFO:tasks.workunit.client.0.smithi029.stderr:--2024-09-21 07:10:45-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-21T07:10:45.920 INFO:tasks.workunit.client.0.smithi029.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-21T07:10:45.942 INFO:tasks.workunit.client.0.smithi029.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-21T07:10:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-21T07:10:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-21T07:10:45.963 INFO:tasks.workunit.client.0.smithi029.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-21T07:10:45.966 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:45.966 INFO:tasks.workunit.client.0.smithi029.stderr: 0K ....... 100% 1.15G=0s 2024-09-21T07:10:45.967 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:45.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-21 07:10:45 (1.15 GB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-21T07:10:45.967 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-21T07:10:45.967 INFO:tasks.workunit.client.0.smithi029.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-21T07:10:45.984 INFO:tasks.workunit.client.0.smithi029.stdout:iogen_3.1p0 2024-09-21T07:10:45.985 INFO:tasks.workunit.client.0.smithi029.stdout:iogen_3.1p0/src 2024-09-21T07:10:45.986 INFO:tasks.workunit.client.0.smithi029.stdout:iogen_3.1p0/src/iogen.8 2024-09-21T07:10:45.987 INFO:tasks.workunit.client.0.smithi029.stdout:iogen_3.1p0/src/iogen.c 2024-09-21T07:10:45.988 INFO:tasks.workunit.client.0.smithi029.stdout:iogen_3.1p0/README 2024-09-21T07:10:45.989 INFO:tasks.workunit.client.0.smithi029.stdout:iogen_3.1p0/Makefile.bsd 2024-09-21T07:10:45.990 INFO:tasks.workunit.client.0.smithi029.stdout:iogen_3.1p0/Makefile 2024-09-21T07:10:45.992 INFO:tasks.workunit.client.0.smithi029.stderr:+ cd iogen_3.1p0 2024-09-21T07:10:45.992 INFO:tasks.workunit.client.0.smithi029.stdout:making iogen 2024-09-21T07:10:45.992 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'making iogen' 2024-09-21T07:10:45.993 INFO:tasks.workunit.client.0.smithi029.stderr:+ make 2024-09-21T07:10:46.000 INFO:tasks.workunit.client.0.smithi029.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-21T07:10:46.343 INFO:tasks.workunit.client.0.smithi029.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-21T07:10:46.477 INFO:tasks.workunit.client.0.smithi029.stdout:running iogen 2024-09-21T07:10:46.478 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'running iogen' 2024-09-21T07:10:46.478 INFO:tasks.workunit.client.0.smithi029.stderr:+ ./iogen -n 5 -s 2g 2024-09-21T07:10:46.479 INFO:tasks.workunit.client.0.smithi029.stderr:child spawned 82116 2024-09-21T07:10:46.479 INFO:tasks.workunit.client.0.smithi029.stderr:child spawned 82117 2024-09-21T07:10:46.479 INFO:tasks.workunit.client.0.smithi029.stderr:child spawned 82118 2024-09-21T07:10:46.479 INFO:tasks.workunit.client.0.smithi029.stderr:child spawned 82119 2024-09-21T07:10:46.479 INFO:tasks.workunit.client.0.smithi029.stderr:child spawned 82120 2024-09-21T07:10:46.479 INFO:tasks.workunit.client.0.smithi029.stdout:sleep for 10 min 2024-09-21T07:10:46.480 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'sleep for 10 min' 2024-09-21T07:10:46.480 INFO:tasks.workunit.client.0.smithi029.stderr:+ sleep 600 2024-09-21T07:10:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:47 smithi066 ceph-mon[34793]: pgmap v390: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:47.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:47 smithi029 ceph-mon[30983]: pgmap v390: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:47 smithi052 ceph-mon[34308]: pgmap v390: 97 pgs: 97 active+clean; 664 KiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-21T07:10:49.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:49 smithi066 ceph-mon[34793]: pgmap v391: 97 pgs: 97 active+clean; 149 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 MiB/s wr, 13 op/s 2024-09-21T07:10:49.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:49 smithi029 ceph-mon[30983]: pgmap v391: 97 pgs: 97 active+clean; 149 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 MiB/s wr, 13 op/s 2024-09-21T07:10:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:49 smithi052 ceph-mon[34308]: pgmap v391: 97 pgs: 97 active+clean; 149 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 12 MiB/s wr, 13 op/s 2024-09-21T07:10:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:51 smithi066 ceph-mon[34793]: pgmap v392: 97 pgs: 97 active+clean; 429 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 36 MiB/s wr, 88 op/s 2024-09-21T07:10:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:51 smithi029 ceph-mon[30983]: pgmap v392: 97 pgs: 97 active+clean; 429 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 36 MiB/s wr, 88 op/s 2024-09-21T07:10:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:51 smithi052 ceph-mon[34308]: pgmap v392: 97 pgs: 97 active+clean; 429 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 36 MiB/s wr, 88 op/s 2024-09-21T07:10:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:53 smithi066 ceph-mon[34793]: pgmap v393: 97 pgs: 97 active+clean; 2.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 189 MiB/s wr, 202 op/s 2024-09-21T07:10:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:53 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:53.883 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:53 smithi029 ceph-mon[30983]: pgmap v393: 97 pgs: 97 active+clean; 2.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 189 MiB/s wr, 202 op/s 2024-09-21T07:10:53.884 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:53 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:53 smithi052 ceph-mon[34308]: pgmap v393: 97 pgs: 97 active+clean; 2.2 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 189 MiB/s wr, 202 op/s 2024-09-21T07:10:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:53 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:10:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:54 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.131 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.131 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.131 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.131 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:54 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:55.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:54 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:55 smithi066 ceph-mon[34793]: pgmap v394: 97 pgs: 97 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 325 MiB/s wr, 251 op/s 2024-09-21T07:10:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:55 smithi066 ceph-mon[34793]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:10:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:55 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:55 smithi029 ceph-mon[30983]: pgmap v394: 97 pgs: 97 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 325 MiB/s wr, 251 op/s 2024-09-21T07:10:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:55 smithi029 ceph-mon[30983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:10:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:55 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:55 smithi052 ceph-mon[34308]: pgmap v394: 97 pgs: 97 active+clean; 3.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 325 MiB/s wr, 251 op/s 2024-09-21T07:10:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:55 smithi052 ceph-mon[34308]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:10:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:10:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:10:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:55 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:10:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:56 smithi066 ceph-mon[34793]: pgmap v395: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 429 MiB/s wr, 313 op/s 2024-09-21T07:10:57.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:56 smithi029 ceph-mon[30983]: pgmap v395: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 429 MiB/s wr, 313 op/s 2024-09-21T07:10:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:56 smithi052 ceph-mon[34308]: pgmap v395: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 429 MiB/s wr, 313 op/s 2024-09-21T07:10:59.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:10:59 smithi052 ceph-mon[34308]: pgmap v396: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 621 MiB/s wr, 662 op/s 2024-09-21T07:10:59.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:10:59 smithi066 ceph-mon[34793]: pgmap v396: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 621 MiB/s wr, 662 op/s 2024-09-21T07:10:59.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:10:59 smithi029 ceph-mon[30983]: pgmap v396: 97 pgs: 97 active+clean; 7.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 621 MiB/s wr, 662 op/s 2024-09-21T07:11:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:01 smithi066 ceph-mon[34793]: pgmap v397: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 657 MiB/s wr, 825 op/s 2024-09-21T07:11:01.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:01 smithi029 ceph-mon[30983]: pgmap v397: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 657 MiB/s wr, 825 op/s 2024-09-21T07:11:01.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:01 smithi052 ceph-mon[34308]: pgmap v397: 97 pgs: 97 active+clean; 7.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 657 MiB/s wr, 825 op/s 2024-09-21T07:11:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:03 smithi066 ceph-mon[34793]: pgmap v398: 97 pgs: 97 active+clean; 8.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 786 MiB/s wr, 1.11k op/s 2024-09-21T07:11:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:03 smithi029 ceph-mon[30983]: pgmap v398: 97 pgs: 97 active+clean; 8.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 786 MiB/s wr, 1.11k op/s 2024-09-21T07:11:03.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:03 smithi052 ceph-mon[34308]: pgmap v398: 97 pgs: 97 active+clean; 8.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 786 MiB/s wr, 1.11k op/s 2024-09-21T07:11:05.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:05 smithi066 ceph-mon[34793]: pgmap v399: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 753 MiB/s wr, 1.11k op/s 2024-09-21T07:11:05.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:05 smithi029 ceph-mon[30983]: pgmap v399: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 753 MiB/s wr, 1.11k op/s 2024-09-21T07:11:05.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:05 smithi052 ceph-mon[34308]: pgmap v399: 97 pgs: 97 active+clean; 9.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 753 MiB/s wr, 1.11k op/s 2024-09-21T07:11:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:07 smithi066 ceph-mon[34793]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 698 MiB/s wr, 1.17k op/s 2024-09-21T07:11:07.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:07 smithi029 ceph-mon[30983]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 698 MiB/s wr, 1.17k op/s 2024-09-21T07:11:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:07 smithi052 ceph-mon[34308]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 698 MiB/s wr, 1.17k op/s 2024-09-21T07:11:09.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:09 smithi029 ceph-mon[30983]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 MiB/s wr, 1.62k op/s 2024-09-21T07:11:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:09 smithi052 ceph-mon[34308]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 MiB/s wr, 1.62k op/s 2024-09-21T07:11:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:09 smithi066 ceph-mon[34793]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 754 MiB/s wr, 1.62k op/s 2024-09-21T07:11:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:11 smithi052 ceph-mon[34308]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 600 MiB/s wr, 1.47k op/s 2024-09-21T07:11:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:11 smithi066 ceph-mon[34793]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 600 MiB/s wr, 1.47k op/s 2024-09-21T07:11:11.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:11 smithi029 ceph-mon[30983]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 600 MiB/s wr, 1.47k op/s 2024-09-21T07:11:13.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:13 smithi052 ceph-mon[34308]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 648 MiB/s wr, 1.72k op/s 2024-09-21T07:11:13.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:13 smithi066 ceph-mon[34793]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 648 MiB/s wr, 1.72k op/s 2024-09-21T07:11:13.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:13 smithi029 ceph-mon[30983]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 648 MiB/s wr, 1.72k op/s 2024-09-21T07:11:15.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:15 smithi066 ceph-mon[34793]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 595 MiB/s wr, 1.43k op/s 2024-09-21T07:11:15.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:15 smithi029 ceph-mon[30983]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 595 MiB/s wr, 1.43k op/s 2024-09-21T07:11:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:15 smithi052 ceph-mon[34308]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 595 MiB/s wr, 1.43k op/s 2024-09-21T07:11:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:17 smithi066 ceph-mon[34793]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 522 MiB/s wr, 1.34k op/s 2024-09-21T07:11:17.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:17 smithi029 ceph-mon[30983]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 522 MiB/s wr, 1.34k op/s 2024-09-21T07:11:17.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:17 smithi052 ceph-mon[34308]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 522 MiB/s wr, 1.34k op/s 2024-09-21T07:11:19.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:19 smithi066 ceph-mon[34793]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 552 MiB/s wr, 1.27k op/s 2024-09-21T07:11:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:19 smithi029 ceph-mon[30983]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 552 MiB/s wr, 1.27k op/s 2024-09-21T07:11:19.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:19 smithi052 ceph-mon[34308]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 552 MiB/s wr, 1.27k op/s 2024-09-21T07:11:21.854 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:21 smithi066 ceph-mon[34793]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 432 MiB/s wr, 778 op/s 2024-09-21T07:11:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:21 smithi029 ceph-mon[30983]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 432 MiB/s wr, 778 op/s 2024-09-21T07:11:21.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:21 smithi052 ceph-mon[34308]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 432 MiB/s wr, 778 op/s 2024-09-21T07:11:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:23 smithi066 ceph-mon[34793]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 526 MiB/s wr, 702 op/s 2024-09-21T07:11:23.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:23 smithi029 ceph-mon[30983]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 526 MiB/s wr, 702 op/s 2024-09-21T07:11:23.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:23 smithi052 ceph-mon[34308]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 526 MiB/s wr, 702 op/s 2024-09-21T07:11:25.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:25 smithi052 ceph-mon[34308]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 527 MiB/s wr, 457 op/s 2024-09-21T07:11:26.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:25 smithi066 ceph-mon[34793]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 527 MiB/s wr, 457 op/s 2024-09-21T07:11:26.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:25 smithi029 ceph-mon[30983]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 527 MiB/s wr, 457 op/s 2024-09-21T07:11:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:27 smithi052 ceph-mon[34308]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 467 MiB/s wr, 457 op/s 2024-09-21T07:11:28.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:27 smithi066 ceph-mon[34793]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 467 MiB/s wr, 457 op/s 2024-09-21T07:11:28.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:27 smithi029 ceph-mon[30983]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 467 MiB/s wr, 457 op/s 2024-09-21T07:11:29.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:29 smithi052 ceph-mon[34308]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 526 MiB/s wr, 566 op/s 2024-09-21T07:11:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:29 smithi066 ceph-mon[34793]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 526 MiB/s wr, 566 op/s 2024-09-21T07:11:30.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:29 smithi029 ceph-mon[30983]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 526 MiB/s wr, 566 op/s 2024-09-21T07:11:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:31 smithi052 ceph-mon[34308]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 453 MiB/s wr, 544 op/s 2024-09-21T07:11:32.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:31 smithi066 ceph-mon[34793]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 453 MiB/s wr, 544 op/s 2024-09-21T07:11:32.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:31 smithi029 ceph-mon[30983]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 453 MiB/s wr, 544 op/s 2024-09-21T07:11:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:33 smithi052 ceph-mon[34308]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 499 MiB/s wr, 567 op/s 2024-09-21T07:11:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:33 smithi066 ceph-mon[34793]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 499 MiB/s wr, 567 op/s 2024-09-21T07:11:34.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:33 smithi029 ceph-mon[30983]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 499 MiB/s wr, 567 op/s 2024-09-21T07:11:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:35 smithi052 ceph-mon[34308]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 456 MiB/s wr, 539 op/s 2024-09-21T07:11:36.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:35 smithi066 ceph-mon[34793]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 456 MiB/s wr, 539 op/s 2024-09-21T07:11:36.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:35 smithi029 ceph-mon[30983]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 456 MiB/s wr, 539 op/s 2024-09-21T07:11:38.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:37 smithi066 ceph-mon[34793]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 395 MiB/s wr, 482 op/s 2024-09-21T07:11:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:37 smithi029 ceph-mon[30983]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 395 MiB/s wr, 482 op/s 2024-09-21T07:11:38.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:37 smithi052 ceph-mon[34308]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 395 MiB/s wr, 482 op/s 2024-09-21T07:11:40.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:39 smithi066 ceph-mon[34793]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 456 MiB/s wr, 753 op/s 2024-09-21T07:11:40.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:39 smithi029 ceph-mon[30983]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 456 MiB/s wr, 753 op/s 2024-09-21T07:11:40.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:39 smithi052 ceph-mon[34308]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 456 MiB/s wr, 753 op/s 2024-09-21T07:11:42.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:41 smithi066 ceph-mon[34793]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 384 MiB/s wr, 678 op/s 2024-09-21T07:11:42.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:41 smithi029 ceph-mon[30983]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 384 MiB/s wr, 678 op/s 2024-09-21T07:11:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:41 smithi052 ceph-mon[34308]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 384 MiB/s wr, 678 op/s 2024-09-21T07:11:43.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:42 smithi052 ceph-mon[34308]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 451 MiB/s wr, 692 op/s 2024-09-21T07:11:43.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:42 smithi066 ceph-mon[34793]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 451 MiB/s wr, 692 op/s 2024-09-21T07:11:43.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:42 smithi029 ceph-mon[30983]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 451 MiB/s wr, 692 op/s 2024-09-21T07:11:45.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:45 smithi052 ceph-mon[34308]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 465 MiB/s wr, 694 op/s 2024-09-21T07:11:45.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:45 smithi066 ceph-mon[34793]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 465 MiB/s wr, 694 op/s 2024-09-21T07:11:45.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:45 smithi029 ceph-mon[30983]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 465 MiB/s wr, 694 op/s 2024-09-21T07:11:47.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:47 smithi052 ceph-mon[34308]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 427 MiB/s wr, 618 op/s 2024-09-21T07:11:47.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:47 smithi066 ceph-mon[34793]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 427 MiB/s wr, 618 op/s 2024-09-21T07:11:47.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:47 smithi029 ceph-mon[30983]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 427 MiB/s wr, 618 op/s 2024-09-21T07:11:49.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:49 smithi066 ceph-mon[34793]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 510 MiB/s wr, 588 op/s 2024-09-21T07:11:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:49 smithi029 ceph-mon[30983]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 510 MiB/s wr, 588 op/s 2024-09-21T07:11:49.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:49 smithi052 ceph-mon[34308]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 510 MiB/s wr, 588 op/s 2024-09-21T07:11:51.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:51 smithi066 ceph-mon[34793]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 439 MiB/s wr, 309 op/s 2024-09-21T07:11:51.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:51 smithi029 ceph-mon[30983]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 439 MiB/s wr, 309 op/s 2024-09-21T07:11:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:51 smithi052 ceph-mon[34308]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 439 MiB/s wr, 309 op/s 2024-09-21T07:11:53.602 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:53 smithi066 ceph-mon[34793]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 481 MiB/s wr, 613 op/s 2024-09-21T07:11:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:53 smithi029 ceph-mon[30983]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 481 MiB/s wr, 613 op/s 2024-09-21T07:11:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:53 smithi052 ceph-mon[34308]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 481 MiB/s wr, 613 op/s 2024-09-21T07:11:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:55 smithi066 ceph-mon[34793]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 451 MiB/s wr, 786 op/s 2024-09-21T07:11:55.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:55 smithi029 ceph-mon[30983]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 451 MiB/s wr, 786 op/s 2024-09-21T07:11:55.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:55 smithi052 ceph-mon[34308]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 451 MiB/s wr, 786 op/s 2024-09-21T07:11:56.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:11:56.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:11:56.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:11:56.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:11:56.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:11:56.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:11:56.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:11:56.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:11:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:11:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:11:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:11:56.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:11:57.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:57 smithi066 ceph-mon[34793]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 391 MiB/s wr, 764 op/s 2024-09-21T07:11:57.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:57 smithi029 ceph-mon[30983]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 391 MiB/s wr, 764 op/s 2024-09-21T07:11:57.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:57 smithi052 ceph-mon[34308]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 391 MiB/s wr, 764 op/s 2024-09-21T07:11:59.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:11:59 smithi066 ceph-mon[34793]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 435 MiB/s wr, 783 op/s 2024-09-21T07:11:59.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:11:59 smithi029 ceph-mon[30983]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 435 MiB/s wr, 783 op/s 2024-09-21T07:11:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:11:59 smithi052 ceph-mon[34308]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 435 MiB/s wr, 783 op/s 2024-09-21T07:12:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:01 smithi066 ceph-mon[34793]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 344 MiB/s wr, 711 op/s 2024-09-21T07:12:01.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:01 smithi029 ceph-mon[30983]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 344 MiB/s wr, 711 op/s 2024-09-21T07:12:01.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:01 smithi052 ceph-mon[34308]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 344 MiB/s wr, 711 op/s 2024-09-21T07:12:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:03 smithi066 ceph-mon[34793]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 398 MiB/s wr, 669 op/s 2024-09-21T07:12:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:03 smithi029 ceph-mon[30983]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 398 MiB/s wr, 669 op/s 2024-09-21T07:12:03.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:03 smithi052 ceph-mon[34308]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 398 MiB/s wr, 669 op/s 2024-09-21T07:12:05.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:05 smithi066 ceph-mon[34793]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 398 MiB/s wr, 336 op/s 2024-09-21T07:12:05.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:05 smithi029 ceph-mon[30983]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 398 MiB/s wr, 336 op/s 2024-09-21T07:12:05.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:05 smithi052 ceph-mon[34308]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 398 MiB/s wr, 336 op/s 2024-09-21T07:12:07.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:07 smithi029 ceph-mon[30983]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 359 MiB/s wr, 137 op/s 2024-09-21T07:12:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:07 smithi052 ceph-mon[34308]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 359 MiB/s wr, 137 op/s 2024-09-21T07:12:07.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:07 smithi066 ceph-mon[34793]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 359 MiB/s wr, 137 op/s 2024-09-21T07:12:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:09 smithi052 ceph-mon[34308]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 430 MiB/s wr, 205 op/s 2024-09-21T07:12:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:09 smithi066 ceph-mon[34793]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 430 MiB/s wr, 205 op/s 2024-09-21T07:12:09.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:09 smithi029 ceph-mon[30983]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 430 MiB/s wr, 205 op/s 2024-09-21T07:12:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:11 smithi052 ceph-mon[34308]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 371 MiB/s wr, 210 op/s 2024-09-21T07:12:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:11 smithi066 ceph-mon[34793]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 371 MiB/s wr, 210 op/s 2024-09-21T07:12:11.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:11 smithi029 ceph-mon[30983]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 371 MiB/s wr, 210 op/s 2024-09-21T07:12:13.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:13 smithi052 ceph-mon[34308]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 432 MiB/s wr, 316 op/s 2024-09-21T07:12:13.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:13 smithi066 ceph-mon[34793]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 432 MiB/s wr, 316 op/s 2024-09-21T07:12:13.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:13 smithi029 ceph-mon[30983]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 432 MiB/s wr, 316 op/s 2024-09-21T07:12:15.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:15 smithi066 ceph-mon[34793]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 419 MiB/s wr, 349 op/s 2024-09-21T07:12:15.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:15 smithi029 ceph-mon[30983]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 419 MiB/s wr, 349 op/s 2024-09-21T07:12:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:15 smithi052 ceph-mon[34308]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 419 MiB/s wr, 349 op/s 2024-09-21T07:12:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:17 smithi066 ceph-mon[34793]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 372 MiB/s wr, 340 op/s 2024-09-21T07:12:17.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:17 smithi029 ceph-mon[30983]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 372 MiB/s wr, 340 op/s 2024-09-21T07:12:17.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:17 smithi052 ceph-mon[34308]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 372 MiB/s wr, 340 op/s 2024-09-21T07:12:19.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:19 smithi066 ceph-mon[34793]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 419 MiB/s wr, 365 op/s 2024-09-21T07:12:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:19 smithi029 ceph-mon[30983]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 419 MiB/s wr, 365 op/s 2024-09-21T07:12:19.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:19 smithi052 ceph-mon[34308]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 419 MiB/s wr, 365 op/s 2024-09-21T07:12:21.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:21 smithi066 ceph-mon[34793]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 339 MiB/s wr, 292 op/s 2024-09-21T07:12:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:21 smithi029 ceph-mon[30983]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 339 MiB/s wr, 292 op/s 2024-09-21T07:12:21.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:21 smithi052 ceph-mon[34308]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 339 MiB/s wr, 292 op/s 2024-09-21T07:12:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:23 smithi066 ceph-mon[34793]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 393 MiB/s wr, 280 op/s 2024-09-21T07:12:23.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:23 smithi029 ceph-mon[30983]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 393 MiB/s wr, 280 op/s 2024-09-21T07:12:23.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:23 smithi052 ceph-mon[34308]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 393 MiB/s wr, 280 op/s 2024-09-21T07:12:25.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:25 smithi066 ceph-mon[34793]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 379 MiB/s wr, 199 op/s 2024-09-21T07:12:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:25 smithi029 ceph-mon[30983]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 379 MiB/s wr, 199 op/s 2024-09-21T07:12:25.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:25 smithi052 ceph-mon[34308]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 379 MiB/s wr, 199 op/s 2024-09-21T07:12:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:27 smithi066 ceph-mon[34793]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 341 MiB/s wr, 154 op/s 2024-09-21T07:12:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:27 smithi029 ceph-mon[30983]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 341 MiB/s wr, 154 op/s 2024-09-21T07:12:27.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:27 smithi052 ceph-mon[34308]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 341 MiB/s wr, 154 op/s 2024-09-21T07:12:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:29 smithi066 ceph-mon[34793]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 409 MiB/s wr, 191 op/s 2024-09-21T07:12:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:29 smithi029 ceph-mon[30983]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 409 MiB/s wr, 191 op/s 2024-09-21T07:12:29.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:29 smithi052 ceph-mon[34308]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 409 MiB/s wr, 191 op/s 2024-09-21T07:12:31.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:31 smithi029 ceph-mon[30983]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 360 MiB/s wr, 172 op/s 2024-09-21T07:12:31.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:31 smithi052 ceph-mon[34308]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 360 MiB/s wr, 172 op/s 2024-09-21T07:12:32.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:31 smithi066 ceph-mon[34793]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 360 MiB/s wr, 172 op/s 2024-09-21T07:12:33.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:33 smithi052 ceph-mon[34308]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 422 MiB/s wr, 207 op/s 2024-09-21T07:12:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:33 smithi066 ceph-mon[34793]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 422 MiB/s wr, 207 op/s 2024-09-21T07:12:34.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:33 smithi029 ceph-mon[30983]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 422 MiB/s wr, 207 op/s 2024-09-21T07:12:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:35 smithi052 ceph-mon[34308]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 406 MiB/s wr, 213 op/s 2024-09-21T07:12:36.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:35 smithi066 ceph-mon[34793]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 406 MiB/s wr, 213 op/s 2024-09-21T07:12:36.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:35 smithi029 ceph-mon[30983]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 406 MiB/s wr, 213 op/s 2024-09-21T07:12:37.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:37 smithi052 ceph-mon[34308]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 366 MiB/s wr, 195 op/s 2024-09-21T07:12:38.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:37 smithi066 ceph-mon[34793]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 366 MiB/s wr, 195 op/s 2024-09-21T07:12:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:37 smithi029 ceph-mon[30983]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 366 MiB/s wr, 195 op/s 2024-09-21T07:12:39.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:39 smithi052 ceph-mon[34308]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 438 MiB/s wr, 235 op/s 2024-09-21T07:12:40.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:39 smithi066 ceph-mon[34793]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 438 MiB/s wr, 235 op/s 2024-09-21T07:12:40.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:39 smithi029 ceph-mon[30983]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 438 MiB/s wr, 235 op/s 2024-09-21T07:12:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:41 smithi052 ceph-mon[34308]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 366 MiB/s wr, 199 op/s 2024-09-21T07:12:42.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:41 smithi066 ceph-mon[34793]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 366 MiB/s wr, 199 op/s 2024-09-21T07:12:42.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:41 smithi029 ceph-mon[30983]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 366 MiB/s wr, 199 op/s 2024-09-21T07:12:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:43 smithi052 ceph-mon[34308]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 413 MiB/s wr, 231 op/s 2024-09-21T07:12:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:43 smithi066 ceph-mon[34793]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 413 MiB/s wr, 231 op/s 2024-09-21T07:12:44.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:43 smithi029 ceph-mon[30983]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 413 MiB/s wr, 231 op/s 2024-09-21T07:12:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:45 smithi052 ceph-mon[34308]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 390 MiB/s wr, 228 op/s 2024-09-21T07:12:46.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:45 smithi066 ceph-mon[34793]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 390 MiB/s wr, 228 op/s 2024-09-21T07:12:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:45 smithi029 ceph-mon[30983]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 390 MiB/s wr, 228 op/s 2024-09-21T07:12:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:47 smithi066 ceph-mon[34793]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 351 MiB/s wr, 209 op/s 2024-09-21T07:12:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:47 smithi029 ceph-mon[30983]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 351 MiB/s wr, 209 op/s 2024-09-21T07:12:48.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:47 smithi052 ceph-mon[34308]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 351 MiB/s wr, 209 op/s 2024-09-21T07:12:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:49 smithi066 ceph-mon[34793]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 408 MiB/s wr, 244 op/s 2024-09-21T07:12:50.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:49 smithi029 ceph-mon[30983]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 408 MiB/s wr, 244 op/s 2024-09-21T07:12:50.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:49 smithi052 ceph-mon[34308]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 408 MiB/s wr, 244 op/s 2024-09-21T07:12:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:51 smithi066 ceph-mon[34793]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 335 MiB/s wr, 205 op/s 2024-09-21T07:12:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:51 smithi029 ceph-mon[30983]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 335 MiB/s wr, 205 op/s 2024-09-21T07:12:52.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:51 smithi052 ceph-mon[34308]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 335 MiB/s wr, 205 op/s 2024-09-21T07:12:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:53 smithi066 ceph-mon[34793]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 397 MiB/s wr, 232 op/s 2024-09-21T07:12:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:53 smithi029 ceph-mon[30983]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 397 MiB/s wr, 232 op/s 2024-09-21T07:12:54.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:53 smithi052 ceph-mon[34308]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 397 MiB/s wr, 232 op/s 2024-09-21T07:12:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:55 smithi066 ceph-mon[34793]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 395 MiB/s wr, 220 op/s 2024-09-21T07:12:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:55 smithi029 ceph-mon[30983]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 395 MiB/s wr, 220 op/s 2024-09-21T07:12:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:55 smithi052 ceph-mon[34308]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 395 MiB/s wr, 220 op/s 2024-09-21T07:12:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:12:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:12:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:12:57.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:56 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:12:57.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:12:57.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:12:57.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:12:57.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:56 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:12:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:12:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:12:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:12:57.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:56 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:12:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:57 smithi066 ceph-mon[34793]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 358 MiB/s wr, 191 op/s 2024-09-21T07:12:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:57 smithi029 ceph-mon[30983]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 358 MiB/s wr, 191 op/s 2024-09-21T07:12:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:57 smithi052 ceph-mon[34308]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 358 MiB/s wr, 191 op/s 2024-09-21T07:13:00.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:12:59 smithi029 ceph-mon[30983]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 417 MiB/s wr, 222 op/s 2024-09-21T07:13:00.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:12:59 smithi052 ceph-mon[34308]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 417 MiB/s wr, 222 op/s 2024-09-21T07:13:00.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:12:59 smithi066 ceph-mon[34793]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 417 MiB/s wr, 222 op/s 2024-09-21T07:13:01.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:00 smithi052 ceph-mon[34308]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:13:01.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:00 smithi052 ceph-mon[34308]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 356 MiB/s wr, 189 op/s 2024-09-21T07:13:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:00 smithi066 ceph-mon[34793]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:13:01.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:00 smithi066 ceph-mon[34793]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 356 MiB/s wr, 189 op/s 2024-09-21T07:13:01.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:00 smithi029 ceph-mon[30983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:13:01.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:00 smithi029 ceph-mon[30983]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 356 MiB/s wr, 189 op/s 2024-09-21T07:13:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:03 smithi052 ceph-mon[34308]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 422 MiB/s wr, 223 op/s 2024-09-21T07:13:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:03 smithi066 ceph-mon[34793]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 422 MiB/s wr, 223 op/s 2024-09-21T07:13:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:03 smithi029 ceph-mon[30983]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 422 MiB/s wr, 223 op/s 2024-09-21T07:13:05.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:05 smithi052 ceph-mon[34308]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 409 MiB/s wr, 224 op/s 2024-09-21T07:13:05.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:05 smithi066 ceph-mon[34793]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 409 MiB/s wr, 224 op/s 2024-09-21T07:13:05.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:05 smithi029 ceph-mon[30983]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 409 MiB/s wr, 224 op/s 2024-09-21T07:13:07.492 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:07 smithi052 ceph-mon[34308]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 360 MiB/s wr, 204 op/s 2024-09-21T07:13:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:07 smithi066 ceph-mon[34793]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 360 MiB/s wr, 204 op/s 2024-09-21T07:13:07.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:07 smithi029 ceph-mon[30983]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 360 MiB/s wr, 204 op/s 2024-09-21T07:13:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:09 smithi066 ceph-mon[34793]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 412 MiB/s wr, 257 op/s 2024-09-21T07:13:09.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:09 smithi029 ceph-mon[30983]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 412 MiB/s wr, 257 op/s 2024-09-21T07:13:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:09 smithi052 ceph-mon[34308]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 412 MiB/s wr, 257 op/s 2024-09-21T07:13:11.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:11 smithi066 ceph-mon[34793]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 346 MiB/s wr, 226 op/s 2024-09-21T07:13:11.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:11 smithi029 ceph-mon[30983]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 346 MiB/s wr, 226 op/s 2024-09-21T07:13:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:11 smithi052 ceph-mon[34308]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 346 MiB/s wr, 226 op/s 2024-09-21T07:13:13.544 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:13 smithi052 ceph-mon[34308]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 397 MiB/s wr, 260 op/s 2024-09-21T07:13:13.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:13 smithi066 ceph-mon[34793]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 397 MiB/s wr, 260 op/s 2024-09-21T07:13:13.622 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:13 smithi029 ceph-mon[30983]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 920 KiB/s rd, 397 MiB/s wr, 260 op/s 2024-09-21T07:13:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:15 smithi066 ceph-mon[34793]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 378 MiB/s wr, 257 op/s 2024-09-21T07:13:15.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:15 smithi029 ceph-mon[30983]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 378 MiB/s wr, 257 op/s 2024-09-21T07:13:15.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:15 smithi052 ceph-mon[34308]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 378 MiB/s wr, 257 op/s 2024-09-21T07:13:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:17 smithi066 ceph-mon[34793]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 334 MiB/s wr, 233 op/s 2024-09-21T07:13:17.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:17 smithi029 ceph-mon[30983]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 334 MiB/s wr, 233 op/s 2024-09-21T07:13:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:17 smithi052 ceph-mon[34308]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 334 MiB/s wr, 233 op/s 2024-09-21T07:13:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:19 smithi066 ceph-mon[34793]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 399 MiB/s wr, 267 op/s 2024-09-21T07:13:19.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:19 smithi029 ceph-mon[30983]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 399 MiB/s wr, 267 op/s 2024-09-21T07:13:19.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:19 smithi052 ceph-mon[34308]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 399 MiB/s wr, 267 op/s 2024-09-21T07:13:21.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:21 smithi066 ceph-mon[34793]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 344 MiB/s wr, 215 op/s 2024-09-21T07:13:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:21 smithi029 ceph-mon[30983]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 344 MiB/s wr, 215 op/s 2024-09-21T07:13:21.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:21 smithi052 ceph-mon[34308]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 344 MiB/s wr, 215 op/s 2024-09-21T07:13:23.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:23 smithi066 ceph-mon[34793]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 408 MiB/s wr, 241 op/s 2024-09-21T07:13:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:23 smithi029 ceph-mon[30983]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 408 MiB/s wr, 241 op/s 2024-09-21T07:13:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:23 smithi052 ceph-mon[34308]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 408 MiB/s wr, 241 op/s 2024-09-21T07:13:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:25 smithi029 ceph-mon[30983]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 392 MiB/s wr, 217 op/s 2024-09-21T07:13:25.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:25 smithi052 ceph-mon[34308]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 392 MiB/s wr, 217 op/s 2024-09-21T07:13:25.853 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:25 smithi066 ceph-mon[34793]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 392 MiB/s wr, 217 op/s 2024-09-21T07:13:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:27 smithi052 ceph-mon[34308]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 348 MiB/s wr, 186 op/s 2024-09-21T07:13:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:27 smithi066 ceph-mon[34793]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 348 MiB/s wr, 186 op/s 2024-09-21T07:13:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:27 smithi029 ceph-mon[30983]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 348 MiB/s wr, 186 op/s 2024-09-21T07:13:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:29 smithi052 ceph-mon[34308]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 418 MiB/s wr, 228 op/s 2024-09-21T07:13:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:29 smithi066 ceph-mon[34793]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 418 MiB/s wr, 228 op/s 2024-09-21T07:13:29.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:29 smithi029 ceph-mon[30983]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 819 KiB/s rd, 418 MiB/s wr, 228 op/s 2024-09-21T07:13:31.674 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:31 smithi029 ceph-mon[30983]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 354 MiB/s wr, 194 op/s 2024-09-21T07:13:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:31 smithi052 ceph-mon[34308]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 354 MiB/s wr, 194 op/s 2024-09-21T07:13:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:31 smithi066 ceph-mon[34793]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 820 KiB/s rd, 354 MiB/s wr, 194 op/s 2024-09-21T07:13:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:33 smithi052 ceph-mon[34308]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 414 MiB/s wr, 241 op/s 2024-09-21T07:13:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:33 smithi066 ceph-mon[34793]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 414 MiB/s wr, 241 op/s 2024-09-21T07:13:33.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:33 smithi029 ceph-mon[30983]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 414 MiB/s wr, 241 op/s 2024-09-21T07:13:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:35 smithi052 ceph-mon[34308]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 393 MiB/s wr, 245 op/s 2024-09-21T07:13:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:35 smithi066 ceph-mon[34793]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 393 MiB/s wr, 245 op/s 2024-09-21T07:13:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:35 smithi029 ceph-mon[30983]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 393 MiB/s wr, 245 op/s 2024-09-21T07:13:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:37 smithi052 ceph-mon[34308]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 358 MiB/s wr, 235 op/s 2024-09-21T07:13:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:37 smithi066 ceph-mon[34793]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 358 MiB/s wr, 235 op/s 2024-09-21T07:13:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:37 smithi029 ceph-mon[30983]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 358 MiB/s wr, 235 op/s 2024-09-21T07:13:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:39 smithi066 ceph-mon[34793]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 398 MiB/s wr, 270 op/s 2024-09-21T07:13:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:39 smithi029 ceph-mon[30983]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 398 MiB/s wr, 270 op/s 2024-09-21T07:13:39.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:39 smithi052 ceph-mon[34308]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 398 MiB/s wr, 270 op/s 2024-09-21T07:13:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:41 smithi029 ceph-mon[30983]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 326 MiB/s wr, 224 op/s 2024-09-21T07:13:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:41 smithi052 ceph-mon[34308]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 326 MiB/s wr, 224 op/s 2024-09-21T07:13:42.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:41 smithi066 ceph-mon[34793]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 326 MiB/s wr, 224 op/s 2024-09-21T07:13:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:43 smithi029 ceph-mon[30983]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 379 MiB/s wr, 252 op/s 2024-09-21T07:13:43.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:43 smithi052 ceph-mon[34308]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 379 MiB/s wr, 252 op/s 2024-09-21T07:13:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:43 smithi066 ceph-mon[34793]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 379 MiB/s wr, 252 op/s 2024-09-21T07:13:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:45 smithi066 ceph-mon[34793]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 372 MiB/s wr, 237 op/s 2024-09-21T07:13:45.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:45 smithi029 ceph-mon[30983]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 372 MiB/s wr, 237 op/s 2024-09-21T07:13:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:45 smithi052 ceph-mon[34308]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 372 MiB/s wr, 237 op/s 2024-09-21T07:13:47.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:47 smithi029 ceph-mon[30983]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 334 MiB/s wr, 204 op/s 2024-09-21T07:13:47.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:47 smithi052 ceph-mon[34308]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 334 MiB/s wr, 204 op/s 2024-09-21T07:13:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:47 smithi066 ceph-mon[34793]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 334 MiB/s wr, 204 op/s 2024-09-21T07:13:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:49 smithi029 ceph-mon[30983]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 397 MiB/s wr, 236 op/s 2024-09-21T07:13:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:49 smithi052 ceph-mon[34308]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 397 MiB/s wr, 236 op/s 2024-09-21T07:13:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:49 smithi066 ceph-mon[34793]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 397 MiB/s wr, 236 op/s 2024-09-21T07:13:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:51 smithi029 ceph-mon[30983]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 354 MiB/s wr, 203 op/s 2024-09-21T07:13:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:51 smithi052 ceph-mon[34308]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 354 MiB/s wr, 203 op/s 2024-09-21T07:13:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:51 smithi066 ceph-mon[34793]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 354 MiB/s wr, 203 op/s 2024-09-21T07:13:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:53 smithi052 ceph-mon[34308]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 411 MiB/s wr, 231 op/s 2024-09-21T07:13:54.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:53 smithi066 ceph-mon[34793]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 411 MiB/s wr, 231 op/s 2024-09-21T07:13:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:53 smithi029 ceph-mon[30983]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 411 MiB/s wr, 231 op/s 2024-09-21T07:13:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:55 smithi052 ceph-mon[34308]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 394 MiB/s wr, 218 op/s 2024-09-21T07:13:56.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:55 smithi066 ceph-mon[34793]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 394 MiB/s wr, 218 op/s 2024-09-21T07:13:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:55 smithi029 ceph-mon[30983]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 394 MiB/s wr, 218 op/s 2024-09-21T07:13:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:57 smithi066 ceph-mon[34793]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 344 MiB/s wr, 186 op/s 2024-09-21T07:13:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:13:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:13:58.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:13:58.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:13:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:57 smithi029 ceph-mon[30983]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 344 MiB/s wr, 186 op/s 2024-09-21T07:13:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:13:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:13:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:13:58.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:13:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:57 smithi052 ceph-mon[34308]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 344 MiB/s wr, 186 op/s 2024-09-21T07:13:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:13:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:13:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:13:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:14:00.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:13:59 smithi066 ceph-mon[34793]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 417 MiB/s wr, 231 op/s 2024-09-21T07:14:00.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:13:59 smithi029 ceph-mon[30983]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 417 MiB/s wr, 231 op/s 2024-09-21T07:14:00.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:13:59 smithi052 ceph-mon[34308]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 417 MiB/s wr, 231 op/s 2024-09-21T07:14:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:01 smithi066 ceph-mon[34793]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 347 MiB/s wr, 196 op/s 2024-09-21T07:14:02.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:01 smithi029 ceph-mon[30983]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 347 MiB/s wr, 196 op/s 2024-09-21T07:14:02.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:01 smithi052 ceph-mon[34308]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 347 MiB/s wr, 196 op/s 2024-09-21T07:14:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:03 smithi066 ceph-mon[34793]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 393 MiB/s wr, 379 op/s 2024-09-21T07:14:04.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:03 smithi029 ceph-mon[30983]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 393 MiB/s wr, 379 op/s 2024-09-21T07:14:04.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:03 smithi052 ceph-mon[34308]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 393 MiB/s wr, 379 op/s 2024-09-21T07:14:05.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:04 smithi052 ceph-mon[34308]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 366 MiB/s wr, 493 op/s 2024-09-21T07:14:05.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:04 smithi066 ceph-mon[34793]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 366 MiB/s wr, 493 op/s 2024-09-21T07:14:05.372 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:04 smithi029 ceph-mon[30983]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 366 MiB/s wr, 493 op/s 2024-09-21T07:14:07.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:07 smithi052 ceph-mon[34308]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 333 MiB/s wr, 475 op/s 2024-09-21T07:14:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:07 smithi066 ceph-mon[34793]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 333 MiB/s wr, 475 op/s 2024-09-21T07:14:07.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:07 smithi029 ceph-mon[30983]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 333 MiB/s wr, 475 op/s 2024-09-21T07:14:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:09 smithi066 ceph-mon[34793]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 382 MiB/s wr, 500 op/s 2024-09-21T07:14:09.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:09 smithi029 ceph-mon[30983]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 382 MiB/s wr, 500 op/s 2024-09-21T07:14:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:09 smithi052 ceph-mon[34308]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 382 MiB/s wr, 500 op/s 2024-09-21T07:14:11.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:11 smithi066 ceph-mon[34793]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 312 MiB/s wr, 451 op/s 2024-09-21T07:14:11.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:11 smithi029 ceph-mon[30983]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 312 MiB/s wr, 451 op/s 2024-09-21T07:14:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:11 smithi052 ceph-mon[34308]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 312 MiB/s wr, 451 op/s 2024-09-21T07:14:13.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:13 smithi066 ceph-mon[34793]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 368 MiB/s wr, 470 op/s 2024-09-21T07:14:13.631 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:13 smithi029 ceph-mon[30983]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 368 MiB/s wr, 470 op/s 2024-09-21T07:14:13.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:13 smithi052 ceph-mon[34308]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 368 MiB/s wr, 470 op/s 2024-09-21T07:14:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:15 smithi066 ceph-mon[34793]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 363 MiB/s wr, 302 op/s 2024-09-21T07:14:15.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:15 smithi029 ceph-mon[30983]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 363 MiB/s wr, 302 op/s 2024-09-21T07:14:15.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:15 smithi052 ceph-mon[34308]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 363 MiB/s wr, 302 op/s 2024-09-21T07:14:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:17 smithi066 ceph-mon[34793]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 337 MiB/s wr, 159 op/s 2024-09-21T07:14:17.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:17 smithi029 ceph-mon[30983]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 337 MiB/s wr, 159 op/s 2024-09-21T07:14:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:17 smithi052 ceph-mon[34308]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 978 KiB/s rd, 337 MiB/s wr, 159 op/s 2024-09-21T07:14:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:19 smithi066 ceph-mon[34793]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 404 MiB/s wr, 181 op/s 2024-09-21T07:14:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:19 smithi029 ceph-mon[30983]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 404 MiB/s wr, 181 op/s 2024-09-21T07:14:19.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:19 smithi052 ceph-mon[34308]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 404 MiB/s wr, 181 op/s 2024-09-21T07:14:21.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:21 smithi052 ceph-mon[34308]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 354 MiB/s wr, 154 op/s 2024-09-21T07:14:21.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:21 smithi066 ceph-mon[34793]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 354 MiB/s wr, 154 op/s 2024-09-21T07:14:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:21 smithi029 ceph-mon[30983]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 354 MiB/s wr, 154 op/s 2024-09-21T07:14:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:23 smithi052 ceph-mon[34308]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 399 MiB/s wr, 232 op/s 2024-09-21T07:14:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:23 smithi066 ceph-mon[34793]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 399 MiB/s wr, 232 op/s 2024-09-21T07:14:23.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:23 smithi029 ceph-mon[30983]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 399 MiB/s wr, 232 op/s 2024-09-21T07:14:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:25 smithi052 ceph-mon[34308]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 377 MiB/s wr, 309 op/s 2024-09-21T07:14:25.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:25 smithi066 ceph-mon[34793]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 377 MiB/s wr, 309 op/s 2024-09-21T07:14:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:25 smithi029 ceph-mon[30983]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 377 MiB/s wr, 309 op/s 2024-09-21T07:14:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:27 smithi052 ceph-mon[34308]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 332 MiB/s wr, 316 op/s 2024-09-21T07:14:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:27 smithi066 ceph-mon[34793]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 332 MiB/s wr, 316 op/s 2024-09-21T07:14:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:27 smithi029 ceph-mon[30983]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 332 MiB/s wr, 316 op/s 2024-09-21T07:14:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:29 smithi052 ceph-mon[34308]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 389 MiB/s wr, 393 op/s 2024-09-21T07:14:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:29 smithi066 ceph-mon[34793]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 389 MiB/s wr, 393 op/s 2024-09-21T07:14:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:29 smithi029 ceph-mon[30983]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 389 MiB/s wr, 393 op/s 2024-09-21T07:14:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:31 smithi052 ceph-mon[34308]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 314 MiB/s wr, 367 op/s 2024-09-21T07:14:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:31 smithi066 ceph-mon[34793]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 314 MiB/s wr, 367 op/s 2024-09-21T07:14:31.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:31 smithi029 ceph-mon[30983]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 314 MiB/s wr, 367 op/s 2024-09-21T07:14:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:33 smithi052 ceph-mon[34308]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 358 MiB/s wr, 494 op/s 2024-09-21T07:14:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:33 smithi066 ceph-mon[34793]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 358 MiB/s wr, 494 op/s 2024-09-21T07:14:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:33 smithi029 ceph-mon[30983]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 358 MiB/s wr, 494 op/s 2024-09-21T07:14:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:35 smithi066 ceph-mon[34793]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 332 MiB/s wr, 640 op/s 2024-09-21T07:14:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:35 smithi029 ceph-mon[30983]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 332 MiB/s wr, 640 op/s 2024-09-21T07:14:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:35 smithi052 ceph-mon[34308]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 332 MiB/s wr, 640 op/s 2024-09-21T07:14:37.854 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:37 smithi066 ceph-mon[34793]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 300 MiB/s wr, 626 op/s 2024-09-21T07:14:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:37 smithi029 ceph-mon[30983]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 300 MiB/s wr, 626 op/s 2024-09-21T07:14:37.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:37 smithi052 ceph-mon[34308]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 300 MiB/s wr, 626 op/s 2024-09-21T07:14:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:39 smithi066 ceph-mon[34793]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 355 MiB/s wr, 693 op/s 2024-09-21T07:14:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:39 smithi029 ceph-mon[30983]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 355 MiB/s wr, 693 op/s 2024-09-21T07:14:39.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:39 smithi052 ceph-mon[34308]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 355 MiB/s wr, 693 op/s 2024-09-21T07:14:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:41 smithi066 ceph-mon[34793]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 300 MiB/s wr, 613 op/s 2024-09-21T07:14:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:41 smithi029 ceph-mon[30983]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 300 MiB/s wr, 613 op/s 2024-09-21T07:14:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:41 smithi052 ceph-mon[34308]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 300 MiB/s wr, 613 op/s 2024-09-21T07:14:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:43 smithi029 ceph-mon[30983]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 359 MiB/s wr, 632 op/s 2024-09-21T07:14:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:43 smithi052 ceph-mon[34308]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 359 MiB/s wr, 632 op/s 2024-09-21T07:14:44.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:43 smithi066 ceph-mon[34793]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 359 MiB/s wr, 632 op/s 2024-09-21T07:14:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:45 smithi052 ceph-mon[34308]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 361 MiB/s wr, 519 op/s 2024-09-21T07:14:46.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:45 smithi066 ceph-mon[34793]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 361 MiB/s wr, 519 op/s 2024-09-21T07:14:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:45 smithi029 ceph-mon[30983]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 361 MiB/s wr, 519 op/s 2024-09-21T07:14:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:47 smithi052 ceph-mon[34308]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 341 MiB/s wr, 296 op/s 2024-09-21T07:14:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:47 smithi066 ceph-mon[34793]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 341 MiB/s wr, 296 op/s 2024-09-21T07:14:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:47 smithi029 ceph-mon[30983]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 341 MiB/s wr, 296 op/s 2024-09-21T07:14:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:49 smithi052 ceph-mon[34308]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 412 MiB/s wr, 240 op/s 2024-09-21T07:14:50.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:49 smithi066 ceph-mon[34793]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 412 MiB/s wr, 240 op/s 2024-09-21T07:14:50.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:49 smithi029 ceph-mon[30983]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 412 MiB/s wr, 240 op/s 2024-09-21T07:14:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:51 smithi052 ceph-mon[34308]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 362 MiB/s wr, 148 op/s 2024-09-21T07:14:52.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:51 smithi066 ceph-mon[34793]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 362 MiB/s wr, 148 op/s 2024-09-21T07:14:52.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:51 smithi029 ceph-mon[30983]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 362 MiB/s wr, 148 op/s 2024-09-21T07:14:54.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:53 smithi029 ceph-mon[30983]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 410 MiB/s wr, 275 op/s 2024-09-21T07:14:54.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:53 smithi052 ceph-mon[34308]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 410 MiB/s wr, 275 op/s 2024-09-21T07:14:54.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:53 smithi066 ceph-mon[34793]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 410 MiB/s wr, 275 op/s 2024-09-21T07:14:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:55 smithi029 ceph-mon[30983]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 385 MiB/s wr, 409 op/s 2024-09-21T07:14:56.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:55 smithi029 ceph-mon[30983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:14:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:55 smithi052 ceph-mon[34308]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 385 MiB/s wr, 409 op/s 2024-09-21T07:14:56.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:55 smithi052 ceph-mon[34308]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:14:56.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:55 smithi066 ceph-mon[34793]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 385 MiB/s wr, 409 op/s 2024-09-21T07:14:56.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:55 smithi066 ceph-mon[34793]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:14:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:57 smithi052 ceph-mon[34308]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 335 MiB/s wr, 441 op/s 2024-09-21T07:14:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:14:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:14:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:14:58.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:57 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:14:58.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:57 smithi066 ceph-mon[34793]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 335 MiB/s wr, 441 op/s 2024-09-21T07:14:58.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:14:58.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:14:58.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:14:58.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:57 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:14:58.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:57 smithi029 ceph-mon[30983]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 335 MiB/s wr, 441 op/s 2024-09-21T07:14:58.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:14:58.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:14:58.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:14:58.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:57 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:14:59.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:14:58 smithi052 ceph-mon[34308]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 378 MiB/s wr, 533 op/s 2024-09-21T07:14:59.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:14:58 smithi066 ceph-mon[34793]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 378 MiB/s wr, 533 op/s 2024-09-21T07:14:59.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:14:58 smithi029 ceph-mon[30983]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 378 MiB/s wr, 533 op/s 2024-09-21T07:15:01.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:01 smithi052 ceph-mon[34308]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 300 MiB/s wr, 511 op/s 2024-09-21T07:15:01.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:01 smithi066 ceph-mon[34793]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 300 MiB/s wr, 511 op/s 2024-09-21T07:15:01.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:01 smithi029 ceph-mon[30983]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 300 MiB/s wr, 511 op/s 2024-09-21T07:15:03.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:03 smithi066 ceph-mon[34793]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 331 MiB/s wr, 535 op/s 2024-09-21T07:15:03.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:03 smithi029 ceph-mon[30983]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 331 MiB/s wr, 535 op/s 2024-09-21T07:15:03.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:03 smithi052 ceph-mon[34308]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 944 KiB/s rd, 331 MiB/s wr, 535 op/s 2024-09-21T07:15:05.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:05 smithi066 ceph-mon[34793]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 306 MiB/s wr, 425 op/s 2024-09-21T07:15:05.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:05 smithi029 ceph-mon[30983]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 306 MiB/s wr, 425 op/s 2024-09-21T07:15:05.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:05 smithi052 ceph-mon[34308]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 306 MiB/s wr, 425 op/s 2024-09-21T07:15:07.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:07 smithi066 ceph-mon[34793]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 277 MiB/s wr, 271 op/s 2024-09-21T07:15:07.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:07 smithi029 ceph-mon[30983]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 277 MiB/s wr, 271 op/s 2024-09-21T07:15:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:07 smithi052 ceph-mon[34308]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 277 MiB/s wr, 271 op/s 2024-09-21T07:15:09.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:09 smithi066 ceph-mon[34793]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 339 MiB/s wr, 251 op/s 2024-09-21T07:15:09.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:09 smithi029 ceph-mon[30983]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 339 MiB/s wr, 251 op/s 2024-09-21T07:15:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:09 smithi052 ceph-mon[34308]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 339 MiB/s wr, 251 op/s 2024-09-21T07:15:11.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:11 smithi066 ceph-mon[34793]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 298 MiB/s wr, 164 op/s 2024-09-21T07:15:11.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:11 smithi029 ceph-mon[30983]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 298 MiB/s wr, 164 op/s 2024-09-21T07:15:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:11 smithi052 ceph-mon[34308]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 298 MiB/s wr, 164 op/s 2024-09-21T07:15:13.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:13 smithi066 ceph-mon[34793]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 361 MiB/s wr, 207 op/s 2024-09-21T07:15:13.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:13 smithi029 ceph-mon[30983]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 361 MiB/s wr, 207 op/s 2024-09-21T07:15:13.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:13 smithi052 ceph-mon[34308]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 361 MiB/s wr, 207 op/s 2024-09-21T07:15:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:15 smithi066 ceph-mon[34793]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 372 MiB/s wr, 223 op/s 2024-09-21T07:15:15.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:15 smithi029 ceph-mon[30983]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 372 MiB/s wr, 223 op/s 2024-09-21T07:15:15.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:15 smithi052 ceph-mon[34308]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 372 MiB/s wr, 223 op/s 2024-09-21T07:15:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:17 smithi066 ceph-mon[34793]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 346 MiB/s wr, 215 op/s 2024-09-21T07:15:17.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:17 smithi029 ceph-mon[30983]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 346 MiB/s wr, 215 op/s 2024-09-21T07:15:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:17 smithi052 ceph-mon[34308]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 346 MiB/s wr, 215 op/s 2024-09-21T07:15:19.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:19 smithi052 ceph-mon[34308]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 408 MiB/s wr, 266 op/s 2024-09-21T07:15:19.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:19 smithi066 ceph-mon[34793]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 408 MiB/s wr, 266 op/s 2024-09-21T07:15:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:19 smithi029 ceph-mon[30983]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 408 MiB/s wr, 266 op/s 2024-09-21T07:15:21.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:21 smithi052 ceph-mon[34308]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 346 MiB/s wr, 245 op/s 2024-09-21T07:15:21.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:21 smithi066 ceph-mon[34793]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 346 MiB/s wr, 245 op/s 2024-09-21T07:15:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:21 smithi029 ceph-mon[30983]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 346 MiB/s wr, 245 op/s 2024-09-21T07:15:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:23 smithi052 ceph-mon[34308]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 380 MiB/s wr, 284 op/s 2024-09-21T07:15:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:23 smithi066 ceph-mon[34793]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 380 MiB/s wr, 284 op/s 2024-09-21T07:15:23.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:23 smithi029 ceph-mon[30983]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 380 MiB/s wr, 284 op/s 2024-09-21T07:15:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:25 smithi052 ceph-mon[34308]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 348 MiB/s wr, 273 op/s 2024-09-21T07:15:25.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:25 smithi066 ceph-mon[34793]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 348 MiB/s wr, 273 op/s 2024-09-21T07:15:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:25 smithi029 ceph-mon[30983]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 348 MiB/s wr, 273 op/s 2024-09-21T07:15:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:27 smithi052 ceph-mon[34308]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 301 MiB/s wr, 241 op/s 2024-09-21T07:15:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:27 smithi066 ceph-mon[34793]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 301 MiB/s wr, 241 op/s 2024-09-21T07:15:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:27 smithi029 ceph-mon[30983]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 301 MiB/s wr, 241 op/s 2024-09-21T07:15:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:29 smithi052 ceph-mon[34308]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 343 MiB/s wr, 276 op/s 2024-09-21T07:15:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:29 smithi066 ceph-mon[34793]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 343 MiB/s wr, 276 op/s 2024-09-21T07:15:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:29 smithi029 ceph-mon[30983]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 343 MiB/s wr, 276 op/s 2024-09-21T07:15:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:31 smithi052 ceph-mon[34308]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 271 MiB/s wr, 231 op/s 2024-09-21T07:15:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:31 smithi066 ceph-mon[34793]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 271 MiB/s wr, 231 op/s 2024-09-21T07:15:31.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:31 smithi029 ceph-mon[30983]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 271 MiB/s wr, 231 op/s 2024-09-21T07:15:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:33 smithi052 ceph-mon[34308]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 311 MiB/s wr, 261 op/s 2024-09-21T07:15:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:33 smithi066 ceph-mon[34793]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 311 MiB/s wr, 261 op/s 2024-09-21T07:15:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:33 smithi029 ceph-mon[30983]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 311 MiB/s wr, 261 op/s 2024-09-21T07:15:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:35 smithi052 ceph-mon[34308]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 308 MiB/s wr, 242 op/s 2024-09-21T07:15:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:35 smithi066 ceph-mon[34793]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 308 MiB/s wr, 242 op/s 2024-09-21T07:15:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:35 smithi029 ceph-mon[30983]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 308 MiB/s wr, 242 op/s 2024-09-21T07:15:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:37 smithi052 ceph-mon[34308]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 282 MiB/s wr, 205 op/s 2024-09-21T07:15:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:37 smithi066 ceph-mon[34793]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 282 MiB/s wr, 205 op/s 2024-09-21T07:15:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:37 smithi029 ceph-mon[30983]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 282 MiB/s wr, 205 op/s 2024-09-21T07:15:39.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:39 smithi052 ceph-mon[34308]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 329 MiB/s wr, 217 op/s 2024-09-21T07:15:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:39 smithi066 ceph-mon[34793]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 329 MiB/s wr, 217 op/s 2024-09-21T07:15:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:39 smithi029 ceph-mon[30983]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 329 MiB/s wr, 217 op/s 2024-09-21T07:15:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:41 smithi052 ceph-mon[34308]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 283 MiB/s wr, 174 op/s 2024-09-21T07:15:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:41 smithi066 ceph-mon[34793]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 283 MiB/s wr, 174 op/s 2024-09-21T07:15:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:41 smithi029 ceph-mon[30983]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 283 MiB/s wr, 174 op/s 2024-09-21T07:15:43.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:43 smithi066 ceph-mon[34793]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 338 MiB/s wr, 193 op/s 2024-09-21T07:15:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:43 smithi029 ceph-mon[30983]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 338 MiB/s wr, 193 op/s 2024-09-21T07:15:43.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:43 smithi052 ceph-mon[34308]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 831 KiB/s rd, 338 MiB/s wr, 193 op/s 2024-09-21T07:15:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:45 smithi066 ceph-mon[34793]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 347 MiB/s wr, 180 op/s 2024-09-21T07:15:45.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:45 smithi029 ceph-mon[30983]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 347 MiB/s wr, 180 op/s 2024-09-21T07:15:45.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:45 smithi052 ceph-mon[34308]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 347 MiB/s wr, 180 op/s 2024-09-21T07:15:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:47 smithi066 ceph-mon[34793]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 312 MiB/s wr, 158 op/s 2024-09-21T07:15:47.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:47 smithi029 ceph-mon[30983]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 312 MiB/s wr, 158 op/s 2024-09-21T07:15:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:47 smithi052 ceph-mon[34308]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 312 MiB/s wr, 158 op/s 2024-09-21T07:15:49.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:49 smithi066 ceph-mon[34793]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 380 MiB/s wr, 201 op/s 2024-09-21T07:15:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:49 smithi029 ceph-mon[30983]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 380 MiB/s wr, 201 op/s 2024-09-21T07:15:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:49 smithi052 ceph-mon[34308]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 380 MiB/s wr, 201 op/s 2024-09-21T07:15:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:51 smithi066 ceph-mon[34793]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 334 MiB/s wr, 184 op/s 2024-09-21T07:15:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:51 smithi029 ceph-mon[30983]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 334 MiB/s wr, 184 op/s 2024-09-21T07:15:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:51 smithi052 ceph-mon[34308]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 334 MiB/s wr, 184 op/s 2024-09-21T07:15:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:53 smithi066 ceph-mon[34793]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 383 MiB/s wr, 239 op/s 2024-09-21T07:15:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:53 smithi029 ceph-mon[30983]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 383 MiB/s wr, 239 op/s 2024-09-21T07:15:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:53 smithi052 ceph-mon[34308]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 383 MiB/s wr, 239 op/s 2024-09-21T07:15:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:55 smithi066 ceph-mon[34793]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 366 MiB/s wr, 268 op/s 2024-09-21T07:15:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:55 smithi029 ceph-mon[30983]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 366 MiB/s wr, 268 op/s 2024-09-21T07:15:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:55 smithi052 ceph-mon[34308]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 366 MiB/s wr, 268 op/s 2024-09-21T07:15:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:57 smithi066 ceph-mon[34793]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 313 MiB/s wr, 254 op/s 2024-09-21T07:15:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:57 smithi029 ceph-mon[30983]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 313 MiB/s wr, 254 op/s 2024-09-21T07:15:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:57 smithi052 ceph-mon[34308]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 313 MiB/s wr, 254 op/s 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:15:58.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:58 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:15:59.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:15:59.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:15:59.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:15:59.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:58 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:15:59.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:15:59.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T07:15:59.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:15:59.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:15:59.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:58 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:15:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:59 smithi052 ceph-mon[34308]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 359 MiB/s wr, 305 op/s 2024-09-21T07:15:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:59 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-21T07:15:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:15:59 smithi052 ceph-mon[34308]: Unable to set osd_memory_target on smithi029 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:16:00.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:59 smithi066 ceph-mon[34793]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 359 MiB/s wr, 305 op/s 2024-09-21T07:16:00.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:59 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-21T07:16:00.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:15:59 smithi066 ceph-mon[34793]: Unable to set osd_memory_target on smithi029 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:16:00.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:59 smithi029 ceph-mon[30983]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 359 MiB/s wr, 305 op/s 2024-09-21T07:16:00.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:59 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-21T07:16:00.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:15:59 smithi029 ceph-mon[30983]: Unable to set osd_memory_target on smithi029 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T07:16:01.923 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:01 smithi029 ceph-mon[30983]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 283 MiB/s wr, 262 op/s 2024-09-21T07:16:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:01 smithi052 ceph-mon[34308]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 283 MiB/s wr, 262 op/s 2024-09-21T07:16:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:01 smithi066 ceph-mon[34793]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 283 MiB/s wr, 262 op/s 2024-09-21T07:16:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:03 smithi052 ceph-mon[34308]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 325 MiB/s wr, 293 op/s 2024-09-21T07:16:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:03 smithi066 ceph-mon[34793]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 325 MiB/s wr, 293 op/s 2024-09-21T07:16:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:03 smithi029 ceph-mon[30983]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 325 MiB/s wr, 293 op/s 2024-09-21T07:16:05.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:05 smithi052 ceph-mon[34308]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 311 MiB/s wr, 272 op/s 2024-09-21T07:16:06.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:05 smithi066 ceph-mon[34793]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 311 MiB/s wr, 272 op/s 2024-09-21T07:16:06.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:05 smithi029 ceph-mon[30983]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 311 MiB/s wr, 272 op/s 2024-09-21T07:16:07.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:07 smithi052 ceph-mon[34308]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 278 MiB/s wr, 227 op/s 2024-09-21T07:16:08.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:07 smithi066 ceph-mon[34793]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 278 MiB/s wr, 227 op/s 2024-09-21T07:16:08.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:07 smithi029 ceph-mon[30983]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 278 MiB/s wr, 227 op/s 2024-09-21T07:16:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:09 smithi052 ceph-mon[34308]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 333 MiB/s wr, 264 op/s 2024-09-21T07:16:10.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:09 smithi066 ceph-mon[34793]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 333 MiB/s wr, 264 op/s 2024-09-21T07:16:10.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:09 smithi029 ceph-mon[30983]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 333 MiB/s wr, 264 op/s 2024-09-21T07:16:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:11 smithi052 ceph-mon[34308]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 282 MiB/s wr, 216 op/s 2024-09-21T07:16:12.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:11 smithi066 ceph-mon[34793]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 282 MiB/s wr, 216 op/s 2024-09-21T07:16:12.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:11 smithi029 ceph-mon[30983]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 282 MiB/s wr, 216 op/s 2024-09-21T07:16:13.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:13 smithi052 ceph-mon[34308]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 335 MiB/s wr, 247 op/s 2024-09-21T07:16:14.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:13 smithi066 ceph-mon[34793]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 335 MiB/s wr, 247 op/s 2024-09-21T07:16:14.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:13 smithi029 ceph-mon[30983]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 335 MiB/s wr, 247 op/s 2024-09-21T07:16:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:15 smithi052 ceph-mon[34308]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 334 MiB/s wr, 236 op/s 2024-09-21T07:16:16.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:15 smithi066 ceph-mon[34793]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 334 MiB/s wr, 236 op/s 2024-09-21T07:16:16.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:15 smithi029 ceph-mon[30983]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 334 MiB/s wr, 236 op/s 2024-09-21T07:16:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:17 smithi066 ceph-mon[34793]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 305 MiB/s wr, 206 op/s 2024-09-21T07:16:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:17 smithi029 ceph-mon[30983]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 305 MiB/s wr, 206 op/s 2024-09-21T07:16:18.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:17 smithi052 ceph-mon[34308]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 305 MiB/s wr, 206 op/s 2024-09-21T07:16:20.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:19 smithi066 ceph-mon[34793]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 373 MiB/s wr, 234 op/s 2024-09-21T07:16:20.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:19 smithi029 ceph-mon[30983]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 373 MiB/s wr, 234 op/s 2024-09-21T07:16:20.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:19 smithi052 ceph-mon[34308]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 373 MiB/s wr, 234 op/s 2024-09-21T07:16:22.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:21 smithi066 ceph-mon[34793]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 321 MiB/s wr, 190 op/s 2024-09-21T07:16:22.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:21 smithi029 ceph-mon[30983]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 321 MiB/s wr, 190 op/s 2024-09-21T07:16:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:21 smithi052 ceph-mon[34308]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 321 MiB/s wr, 190 op/s 2024-09-21T07:16:24.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:23 smithi066 ceph-mon[34793]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 362 MiB/s wr, 254 op/s 2024-09-21T07:16:24.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:23 smithi029 ceph-mon[30983]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 362 MiB/s wr, 254 op/s 2024-09-21T07:16:24.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:23 smithi052 ceph-mon[34308]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 362 MiB/s wr, 254 op/s 2024-09-21T07:16:26.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:25 smithi066 ceph-mon[34793]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 343 MiB/s wr, 307 op/s 2024-09-21T07:16:26.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:25 smithi029 ceph-mon[30983]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 343 MiB/s wr, 307 op/s 2024-09-21T07:16:26.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:25 smithi052 ceph-mon[34308]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 343 MiB/s wr, 307 op/s 2024-09-21T07:16:28.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:27 smithi066 ceph-mon[34793]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 297 MiB/s wr, 306 op/s 2024-09-21T07:16:28.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:27 smithi029 ceph-mon[30983]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 297 MiB/s wr, 306 op/s 2024-09-21T07:16:28.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:27 smithi052 ceph-mon[34308]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 297 MiB/s wr, 306 op/s 2024-09-21T07:16:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:29 smithi066 ceph-mon[34793]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 340 MiB/s wr, 406 op/s 2024-09-21T07:16:30.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:29 smithi029 ceph-mon[30983]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 340 MiB/s wr, 406 op/s 2024-09-21T07:16:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:29 smithi052 ceph-mon[34308]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 340 MiB/s wr, 406 op/s 2024-09-21T07:16:32.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:31 smithi066 ceph-mon[34793]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 269 MiB/s wr, 391 op/s 2024-09-21T07:16:32.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:31 smithi029 ceph-mon[30983]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 269 MiB/s wr, 391 op/s 2024-09-21T07:16:32.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:31 smithi052 ceph-mon[34308]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 269 MiB/s wr, 391 op/s 2024-09-21T07:16:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:33 smithi066 ceph-mon[34793]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 313 MiB/s wr, 469 op/s 2024-09-21T07:16:34.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:33 smithi029 ceph-mon[30983]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 313 MiB/s wr, 469 op/s 2024-09-21T07:16:34.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:33 smithi052 ceph-mon[34308]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 313 MiB/s wr, 469 op/s 2024-09-21T07:16:36.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:35 smithi029 ceph-mon[30983]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 303 MiB/s wr, 469 op/s 2024-09-21T07:16:36.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:35 smithi052 ceph-mon[34308]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 303 MiB/s wr, 469 op/s 2024-09-21T07:16:36.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:35 smithi066 ceph-mon[34793]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 303 MiB/s wr, 469 op/s 2024-09-21T07:16:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:37 smithi029 ceph-mon[30983]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 271 MiB/s wr, 406 op/s 2024-09-21T07:16:38.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:37 smithi052 ceph-mon[34308]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 271 MiB/s wr, 406 op/s 2024-09-21T07:16:38.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:37 smithi066 ceph-mon[34793]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 271 MiB/s wr, 406 op/s 2024-09-21T07:16:40.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:39 smithi029 ceph-mon[30983]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 317 MiB/s wr, 483 op/s 2024-09-21T07:16:40.153 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:39 smithi066 ceph-mon[34793]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 317 MiB/s wr, 483 op/s 2024-09-21T07:16:40.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:39 smithi052 ceph-mon[34308]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 317 MiB/s wr, 483 op/s 2024-09-21T07:16:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:41 smithi052 ceph-mon[34308]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 266 MiB/s wr, 400 op/s 2024-09-21T07:16:42.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:41 smithi066 ceph-mon[34793]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 266 MiB/s wr, 400 op/s 2024-09-21T07:16:42.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:41 smithi029 ceph-mon[30983]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 266 MiB/s wr, 400 op/s 2024-09-21T07:16:43.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:42 smithi052 ceph-mon[34308]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 317 MiB/s wr, 449 op/s 2024-09-21T07:16:43.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:42 smithi066 ceph-mon[34793]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 317 MiB/s wr, 449 op/s 2024-09-21T07:16:43.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:42 smithi029 ceph-mon[30983]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 317 MiB/s wr, 449 op/s 2024-09-21T07:16:45.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:45 smithi066 ceph-mon[34793]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 316 MiB/s wr, 415 op/s 2024-09-21T07:16:45.634 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:45 smithi029 ceph-mon[30983]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 316 MiB/s wr, 415 op/s 2024-09-21T07:16:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:45 smithi052 ceph-mon[34308]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 316 MiB/s wr, 415 op/s 2024-09-21T07:16:47.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:47 smithi066 ceph-mon[34793]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 292 MiB/s wr, 353 op/s 2024-09-21T07:16:47.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:47 smithi029 ceph-mon[30983]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 292 MiB/s wr, 353 op/s 2024-09-21T07:16:47.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:47 smithi052 ceph-mon[34308]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 292 MiB/s wr, 353 op/s 2024-09-21T07:16:49.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:49 smithi066 ceph-mon[34793]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 364 MiB/s wr, 356 op/s 2024-09-21T07:16:49.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:49 smithi029 ceph-mon[30983]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 364 MiB/s wr, 356 op/s 2024-09-21T07:16:49.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:49 smithi052 ceph-mon[34308]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 364 MiB/s wr, 356 op/s 2024-09-21T07:16:51.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:51 smithi066 ceph-mon[34793]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 322 MiB/s wr, 256 op/s 2024-09-21T07:16:51.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:51 smithi029 ceph-mon[30983]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 322 MiB/s wr, 256 op/s 2024-09-21T07:16:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:51 smithi052 ceph-mon[34308]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 322 MiB/s wr, 256 op/s 2024-09-21T07:16:53.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:53 smithi066 ceph-mon[34793]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 372 MiB/s wr, 316 op/s 2024-09-21T07:16:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:53 smithi029 ceph-mon[30983]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 372 MiB/s wr, 316 op/s 2024-09-21T07:16:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:53 smithi052 ceph-mon[34308]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 372 MiB/s wr, 316 op/s 2024-09-21T07:16:55.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:55 smithi066 ceph-mon[34793]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 349 MiB/s wr, 339 op/s 2024-09-21T07:16:55.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:55 smithi029 ceph-mon[30983]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 349 MiB/s wr, 339 op/s 2024-09-21T07:16:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:55 smithi052 ceph-mon[34308]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 349 MiB/s wr, 339 op/s 2024-09-21T07:16:57.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:57 smithi029 ceph-mon[30983]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 302 MiB/s wr, 319 op/s 2024-09-21T07:16:57.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:57 smithi052 ceph-mon[34308]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 302 MiB/s wr, 319 op/s 2024-09-21T07:16:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:57 smithi066 ceph-mon[34793]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 302 MiB/s wr, 319 op/s 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 339 MiB/s wr, 416 op/s 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:16:59.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:16:59.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:16:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:16:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 339 MiB/s wr, 416 op/s 2024-09-21T07:16:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:16:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:16:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:16:59.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:16:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:16:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 339 MiB/s wr, 416 op/s 2024-09-21T07:16:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:16:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T07:16:59.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:16:59.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:16:59.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:16:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:17:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:00 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-21T07:17:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:00 smithi052 ceph-mon[34308]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-21T07:17:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:00 smithi052 ceph-mon[34308]: Unable to set osd_memory_target on smithi066 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-21T07:17:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:00 smithi052 ceph-mon[34308]: Unable to set osd_memory_target on smithi052 to 185699225: error parsing value: Value '185699225' is below minimum 939524096 2024-09-21T07:17:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:00 smithi052 ceph-mon[34308]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:17:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:00 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-21T07:17:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:00 smithi066 ceph-mon[34793]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-21T07:17:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:00 smithi066 ceph-mon[34793]: Unable to set osd_memory_target on smithi066 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-21T07:17:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:00 smithi066 ceph-mon[34793]: Unable to set osd_memory_target on smithi052 to 185699225: error parsing value: Value '185699225' is below minimum 939524096 2024-09-21T07:17:00.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:00 smithi066 ceph-mon[34793]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:17:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:00 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-09-21T07:17:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:00 smithi029 ceph-mon[30983]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-21T07:17:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:00 smithi029 ceph-mon[30983]: Unable to set osd_memory_target on smithi066 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-09-21T07:17:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:00 smithi029 ceph-mon[30983]: Unable to set osd_memory_target on smithi052 to 185699225: error parsing value: Value '185699225' is below minimum 939524096 2024-09-21T07:17:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:00 smithi029 ceph-mon[30983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:17:01.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:01 smithi052 ceph-mon[34308]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 268 MiB/s wr, 413 op/s 2024-09-21T07:17:01.774 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:01 smithi029 ceph-mon[30983]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 268 MiB/s wr, 413 op/s 2024-09-21T07:17:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:01 smithi066 ceph-mon[34793]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 268 MiB/s wr, 413 op/s 2024-09-21T07:17:03.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:03 smithi052 ceph-mon[34308]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 307 MiB/s wr, 502 op/s 2024-09-21T07:17:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:03 smithi066 ceph-mon[34793]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 307 MiB/s wr, 502 op/s 2024-09-21T07:17:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:03 smithi029 ceph-mon[30983]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 307 MiB/s wr, 502 op/s 2024-09-21T07:17:05.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:05 smithi052 ceph-mon[34308]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 286 MiB/s wr, 472 op/s 2024-09-21T07:17:05.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:05 smithi066 ceph-mon[34793]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 286 MiB/s wr, 472 op/s 2024-09-21T07:17:05.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:05 smithi029 ceph-mon[30983]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 286 MiB/s wr, 472 op/s 2024-09-21T07:17:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:07 smithi052 ceph-mon[34308]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 270 MiB/s wr, 401 op/s 2024-09-21T07:17:07.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:07 smithi066 ceph-mon[34793]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 270 MiB/s wr, 401 op/s 2024-09-21T07:17:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:07 smithi029 ceph-mon[30983]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 270 MiB/s wr, 401 op/s 2024-09-21T07:17:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:09 smithi066 ceph-mon[34793]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 310 MiB/s wr, 413 op/s 2024-09-21T07:17:09.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:09 smithi029 ceph-mon[30983]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 310 MiB/s wr, 413 op/s 2024-09-21T07:17:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:09 smithi052 ceph-mon[34308]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 310 MiB/s wr, 413 op/s 2024-09-21T07:17:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:11 smithi066 ceph-mon[34793]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 264 MiB/s wr, 316 op/s 2024-09-21T07:17:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:11 smithi029 ceph-mon[30983]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 264 MiB/s wr, 316 op/s 2024-09-21T07:17:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:11 smithi052 ceph-mon[34308]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 264 MiB/s wr, 316 op/s 2024-09-21T07:17:13.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:13 smithi066 ceph-mon[34793]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 310 MiB/s wr, 333 op/s 2024-09-21T07:17:13.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:13 smithi029 ceph-mon[30983]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 310 MiB/s wr, 333 op/s 2024-09-21T07:17:13.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:13 smithi052 ceph-mon[34308]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 310 MiB/s wr, 333 op/s 2024-09-21T07:17:15.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:15 smithi066 ceph-mon[34793]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 304 MiB/s wr, 269 op/s 2024-09-21T07:17:15.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:15 smithi029 ceph-mon[30983]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 304 MiB/s wr, 269 op/s 2024-09-21T07:17:15.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:15 smithi052 ceph-mon[34308]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 304 MiB/s wr, 269 op/s 2024-09-21T07:17:17.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:17 smithi066 ceph-mon[34793]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 297 MiB/s wr, 229 op/s 2024-09-21T07:17:17.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:17 smithi029 ceph-mon[30983]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 297 MiB/s wr, 229 op/s 2024-09-21T07:17:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:17 smithi052 ceph-mon[34308]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 297 MiB/s wr, 229 op/s 2024-09-21T07:17:19.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:19 smithi066 ceph-mon[34793]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 323 MiB/s wr, 223 op/s 2024-09-21T07:17:19.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:19 smithi029 ceph-mon[30983]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 323 MiB/s wr, 223 op/s 2024-09-21T07:17:19.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:19 smithi052 ceph-mon[34308]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 323 MiB/s wr, 223 op/s 2024-09-21T07:17:21.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:21 smithi066 ceph-mon[34793]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 294 MiB/s wr, 195 op/s 2024-09-21T07:17:21.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:21 smithi029 ceph-mon[30983]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 294 MiB/s wr, 195 op/s 2024-09-21T07:17:21.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:21 smithi052 ceph-mon[34308]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 294 MiB/s wr, 195 op/s 2024-09-21T07:17:23.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:23 smithi066 ceph-mon[34793]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 344 MiB/s wr, 292 op/s 2024-09-21T07:17:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:23 smithi029 ceph-mon[30983]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 344 MiB/s wr, 292 op/s 2024-09-21T07:17:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:23 smithi052 ceph-mon[34308]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 344 MiB/s wr, 292 op/s 2024-09-21T07:17:25.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:25 smithi066 ceph-mon[34793]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 321 MiB/s wr, 366 op/s 2024-09-21T07:17:25.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:25 smithi029 ceph-mon[30983]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 321 MiB/s wr, 366 op/s 2024-09-21T07:17:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:25 smithi052 ceph-mon[34308]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 321 MiB/s wr, 366 op/s 2024-09-21T07:17:27.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:27 smithi029 ceph-mon[30983]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 292 MiB/s wr, 411 op/s 2024-09-21T07:17:27.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:27 smithi052 ceph-mon[34308]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 292 MiB/s wr, 411 op/s 2024-09-21T07:17:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:27 smithi066 ceph-mon[34793]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 292 MiB/s wr, 411 op/s 2024-09-21T07:17:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:29 smithi052 ceph-mon[34308]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 302 MiB/s wr, 526 op/s 2024-09-21T07:17:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:29 smithi066 ceph-mon[34793]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 302 MiB/s wr, 526 op/s 2024-09-21T07:17:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:29 smithi029 ceph-mon[30983]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 302 MiB/s wr, 526 op/s 2024-09-21T07:17:31.672 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:31 smithi029 ceph-mon[30983]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 261 MiB/s wr, 545 op/s 2024-09-21T07:17:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:31 smithi052 ceph-mon[34308]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 261 MiB/s wr, 545 op/s 2024-09-21T07:17:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:31 smithi066 ceph-mon[34793]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 261 MiB/s wr, 545 op/s 2024-09-21T07:17:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:33 smithi052 ceph-mon[34308]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 294 MiB/s wr, 680 op/s 2024-09-21T07:17:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:33 smithi066 ceph-mon[34793]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 294 MiB/s wr, 680 op/s 2024-09-21T07:17:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:33 smithi029 ceph-mon[30983]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 294 MiB/s wr, 680 op/s 2024-09-21T07:17:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:35 smithi052 ceph-mon[34308]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 272 MiB/s wr, 694 op/s 2024-09-21T07:17:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:35 smithi066 ceph-mon[34793]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 272 MiB/s wr, 694 op/s 2024-09-21T07:17:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:35 smithi029 ceph-mon[30983]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 272 MiB/s wr, 694 op/s 2024-09-21T07:17:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:37 smithi052 ceph-mon[34308]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 259 MiB/s wr, 666 op/s 2024-09-21T07:17:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:37 smithi066 ceph-mon[34793]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 259 MiB/s wr, 666 op/s 2024-09-21T07:17:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:37 smithi029 ceph-mon[30983]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 259 MiB/s wr, 666 op/s 2024-09-21T07:17:39.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:39 smithi052 ceph-mon[34308]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 282 MiB/s wr, 747 op/s 2024-09-21T07:17:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:39 smithi066 ceph-mon[34793]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 282 MiB/s wr, 747 op/s 2024-09-21T07:17:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:39 smithi029 ceph-mon[30983]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 282 MiB/s wr, 747 op/s 2024-09-21T07:17:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:41 smithi052 ceph-mon[34308]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 249 MiB/s wr, 670 op/s 2024-09-21T07:17:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:41 smithi066 ceph-mon[34793]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 249 MiB/s wr, 670 op/s 2024-09-21T07:17:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:41 smithi029 ceph-mon[30983]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 249 MiB/s wr, 670 op/s 2024-09-21T07:17:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:43 smithi052 ceph-mon[34308]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 287 MiB/s wr, 812 op/s 2024-09-21T07:17:43.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:43 smithi066 ceph-mon[34793]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 287 MiB/s wr, 812 op/s 2024-09-21T07:17:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:43 smithi029 ceph-mon[30983]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 287 MiB/s wr, 812 op/s 2024-09-21T07:17:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:45 smithi066 ceph-mon[34793]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 276 MiB/s wr, 824 op/s 2024-09-21T07:17:45.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:45 smithi029 ceph-mon[30983]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 276 MiB/s wr, 824 op/s 2024-09-21T07:17:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:45 smithi052 ceph-mon[34308]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 276 MiB/s wr, 824 op/s 2024-09-21T07:17:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:47 smithi066 ceph-mon[34793]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 274 MiB/s wr, 775 op/s 2024-09-21T07:17:47.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:47 smithi029 ceph-mon[30983]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 274 MiB/s wr, 775 op/s 2024-09-21T07:17:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:47 smithi052 ceph-mon[34308]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 274 MiB/s wr, 775 op/s 2024-09-21T07:17:49.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:49 smithi066 ceph-mon[34793]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 311 MiB/s wr, 743 op/s 2024-09-21T07:17:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:49 smithi029 ceph-mon[30983]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 311 MiB/s wr, 743 op/s 2024-09-21T07:17:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:49 smithi052 ceph-mon[34308]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 311 MiB/s wr, 743 op/s 2024-09-21T07:17:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:51 smithi066 ceph-mon[34793]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 289 MiB/s wr, 603 op/s 2024-09-21T07:17:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:51 smithi029 ceph-mon[30983]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 289 MiB/s wr, 603 op/s 2024-09-21T07:17:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:51 smithi052 ceph-mon[34308]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 289 MiB/s wr, 603 op/s 2024-09-21T07:17:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:53 smithi066 ceph-mon[34793]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 334 MiB/s wr, 641 op/s 2024-09-21T07:17:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:53 smithi029 ceph-mon[30983]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 334 MiB/s wr, 641 op/s 2024-09-21T07:17:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:53 smithi052 ceph-mon[34308]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 334 MiB/s wr, 641 op/s 2024-09-21T07:17:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:55 smithi066 ceph-mon[34793]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 320 MiB/s wr, 564 op/s 2024-09-21T07:17:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:55 smithi029 ceph-mon[30983]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 320 MiB/s wr, 564 op/s 2024-09-21T07:17:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:55 smithi052 ceph-mon[34308]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 320 MiB/s wr, 564 op/s 2024-09-21T07:17:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:57 smithi066 ceph-mon[34793]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 299 MiB/s wr, 475 op/s 2024-09-21T07:17:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:57 smithi029 ceph-mon[30983]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 299 MiB/s wr, 475 op/s 2024-09-21T07:17:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:57 smithi052 ceph-mon[34308]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 299 MiB/s wr, 475 op/s 2024-09-21T07:17:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:59 smithi066 ceph-mon[34793]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 303 MiB/s wr, 507 op/s 2024-09-21T07:17:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:17:59 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:17:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:59 smithi029 ceph-mon[30983]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 303 MiB/s wr, 507 op/s 2024-09-21T07:17:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:17:59 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:17:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:59 smithi052 ceph-mon[34308]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 303 MiB/s wr, 507 op/s 2024-09-21T07:17:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:17:59 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:18:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:18:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:18:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:18:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:18:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:18:00.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:18:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:18:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:18:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:18:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:01 smithi052 ceph-mon[34308]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 249 MiB/s wr, 476 op/s 2024-09-21T07:18:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:01 smithi066 ceph-mon[34793]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 249 MiB/s wr, 476 op/s 2024-09-21T07:18:02.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:01 smithi029 ceph-mon[30983]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 249 MiB/s wr, 476 op/s 2024-09-21T07:18:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:03 smithi052 ceph-mon[34308]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 276 MiB/s wr, 552 op/s 2024-09-21T07:18:04.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:03 smithi066 ceph-mon[34793]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 276 MiB/s wr, 552 op/s 2024-09-21T07:18:04.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:03 smithi029 ceph-mon[30983]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 276 MiB/s wr, 552 op/s 2024-09-21T07:18:05.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:05 smithi052 ceph-mon[34308]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 260 MiB/s wr, 526 op/s 2024-09-21T07:18:06.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:05 smithi066 ceph-mon[34793]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 260 MiB/s wr, 526 op/s 2024-09-21T07:18:06.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:05 smithi029 ceph-mon[30983]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 260 MiB/s wr, 526 op/s 2024-09-21T07:18:07.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:07 smithi052 ceph-mon[34308]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 244 MiB/s wr, 451 op/s 2024-09-21T07:18:08.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:07 smithi066 ceph-mon[34793]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 244 MiB/s wr, 451 op/s 2024-09-21T07:18:08.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:07 smithi029 ceph-mon[30983]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 244 MiB/s wr, 451 op/s 2024-09-21T07:18:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:09 smithi052 ceph-mon[34308]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 264 MiB/s wr, 424 op/s 2024-09-21T07:18:10.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:09 smithi066 ceph-mon[34793]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 264 MiB/s wr, 424 op/s 2024-09-21T07:18:10.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:09 smithi029 ceph-mon[30983]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 264 MiB/s wr, 424 op/s 2024-09-21T07:18:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:11 smithi052 ceph-mon[34308]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 234 MiB/s wr, 337 op/s 2024-09-21T07:18:12.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:11 smithi066 ceph-mon[34793]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 234 MiB/s wr, 337 op/s 2024-09-21T07:18:12.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:11 smithi029 ceph-mon[30983]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 234 MiB/s wr, 337 op/s 2024-09-21T07:18:13.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:13 smithi052 ceph-mon[34308]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 276 MiB/s wr, 394 op/s 2024-09-21T07:18:14.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:13 smithi066 ceph-mon[34793]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 276 MiB/s wr, 394 op/s 2024-09-21T07:18:14.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:13 smithi029 ceph-mon[30983]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 276 MiB/s wr, 394 op/s 2024-09-21T07:18:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:15 smithi052 ceph-mon[34308]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 264 MiB/s wr, 389 op/s 2024-09-21T07:18:16.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:15 smithi066 ceph-mon[34793]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 264 MiB/s wr, 389 op/s 2024-09-21T07:18:16.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:15 smithi029 ceph-mon[30983]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 264 MiB/s wr, 389 op/s 2024-09-21T07:18:18.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:17 smithi029 ceph-mon[30983]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 254 MiB/s wr, 379 op/s 2024-09-21T07:18:18.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:17 smithi052 ceph-mon[34308]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 254 MiB/s wr, 379 op/s 2024-09-21T07:18:18.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:17 smithi066 ceph-mon[34793]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 254 MiB/s wr, 379 op/s 2024-09-21T07:18:20.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:19 smithi029 ceph-mon[30983]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 281 MiB/s wr, 408 op/s 2024-09-21T07:18:20.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:19 smithi052 ceph-mon[34308]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 281 MiB/s wr, 408 op/s 2024-09-21T07:18:20.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:19 smithi066 ceph-mon[34793]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 281 MiB/s wr, 408 op/s 2024-09-21T07:18:22.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:21 smithi029 ceph-mon[30983]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 266 MiB/s wr, 412 op/s 2024-09-21T07:18:22.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:21 smithi052 ceph-mon[34308]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 266 MiB/s wr, 412 op/s 2024-09-21T07:18:22.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:21 smithi066 ceph-mon[34793]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 266 MiB/s wr, 412 op/s 2024-09-21T07:18:24.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:23 smithi052 ceph-mon[34308]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 296 MiB/s wr, 505 op/s 2024-09-21T07:18:24.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:23 smithi066 ceph-mon[34793]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 296 MiB/s wr, 505 op/s 2024-09-21T07:18:24.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:23 smithi029 ceph-mon[30983]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 296 MiB/s wr, 505 op/s 2024-09-21T07:18:26.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:25 smithi052 ceph-mon[34308]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 283 MiB/s wr, 607 op/s 2024-09-21T07:18:26.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:25 smithi066 ceph-mon[34793]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 283 MiB/s wr, 607 op/s 2024-09-21T07:18:26.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:25 smithi029 ceph-mon[30983]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 283 MiB/s wr, 607 op/s 2024-09-21T07:18:28.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:27 smithi052 ceph-mon[34308]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 264 MiB/s wr, 650 op/s 2024-09-21T07:18:28.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:27 smithi066 ceph-mon[34793]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 264 MiB/s wr, 650 op/s 2024-09-21T07:18:28.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:27 smithi029 ceph-mon[30983]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 264 MiB/s wr, 650 op/s 2024-09-21T07:18:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:29 smithi052 ceph-mon[34308]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 272 MiB/s wr, 812 op/s 2024-09-21T07:18:30.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:29 smithi066 ceph-mon[34793]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 272 MiB/s wr, 812 op/s 2024-09-21T07:18:30.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:29 smithi029 ceph-mon[30983]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 272 MiB/s wr, 812 op/s 2024-09-21T07:18:31.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:30 smithi052 ceph-mon[34308]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 247 MiB/s wr, 892 op/s 2024-09-21T07:18:31.272 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:30 smithi029 ceph-mon[30983]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 247 MiB/s wr, 892 op/s 2024-09-21T07:18:31.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:30 smithi066 ceph-mon[34793]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 247 MiB/s wr, 892 op/s 2024-09-21T07:18:33.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:33 smithi066 ceph-mon[34793]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 252 MiB/s wr, 1.01k op/s 2024-09-21T07:18:33.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:33 smithi029 ceph-mon[30983]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 252 MiB/s wr, 1.01k op/s 2024-09-21T07:18:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:33 smithi052 ceph-mon[34308]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 252 MiB/s wr, 1.01k op/s 2024-09-21T07:18:35.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:35 smithi066 ceph-mon[34793]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 239 MiB/s wr, 1.01k op/s 2024-09-21T07:18:35.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:35 smithi029 ceph-mon[30983]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 239 MiB/s wr, 1.01k op/s 2024-09-21T07:18:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:35 smithi052 ceph-mon[34308]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 239 MiB/s wr, 1.01k op/s 2024-09-21T07:18:37.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:37 smithi066 ceph-mon[34793]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 225 MiB/s wr, 844 op/s 2024-09-21T07:18:37.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:37 smithi029 ceph-mon[30983]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 225 MiB/s wr, 844 op/s 2024-09-21T07:18:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:37 smithi052 ceph-mon[34308]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 225 MiB/s wr, 844 op/s 2024-09-21T07:18:39.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:39 smithi029 ceph-mon[30983]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 244 MiB/s wr, 755 op/s 2024-09-21T07:18:39.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:39 smithi052 ceph-mon[34308]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 244 MiB/s wr, 755 op/s 2024-09-21T07:18:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:39 smithi066 ceph-mon[34793]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 244 MiB/s wr, 755 op/s 2024-09-21T07:18:41.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:41 smithi029 ceph-mon[30983]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 233 MiB/s wr, 601 op/s 2024-09-21T07:18:41.653 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:41 smithi066 ceph-mon[34793]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 233 MiB/s wr, 601 op/s 2024-09-21T07:18:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:41 smithi052 ceph-mon[34308]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 233 MiB/s wr, 601 op/s 2024-09-21T07:18:43.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:43 smithi029 ceph-mon[30983]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 243 MiB/s wr, 597 op/s 2024-09-21T07:18:43.742 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:43 smithi052 ceph-mon[34308]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 243 MiB/s wr, 597 op/s 2024-09-21T07:18:43.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:43 smithi066 ceph-mon[34793]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 243 MiB/s wr, 597 op/s 2024-09-21T07:18:45.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:45 smithi052 ceph-mon[34308]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 247 MiB/s wr, 624 op/s 2024-09-21T07:18:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:45 smithi066 ceph-mon[34793]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 247 MiB/s wr, 624 op/s 2024-09-21T07:18:45.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:45 smithi029 ceph-mon[30983]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 247 MiB/s wr, 624 op/s 2024-09-21T07:18:47.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:47 smithi052 ceph-mon[34308]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 245 MiB/s wr, 620 op/s 2024-09-21T07:18:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:47 smithi066 ceph-mon[34793]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 245 MiB/s wr, 620 op/s 2024-09-21T07:18:47.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:47 smithi029 ceph-mon[30983]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 245 MiB/s wr, 620 op/s 2024-09-21T07:18:49.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:49 smithi052 ceph-mon[34308]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 264 MiB/s wr, 683 op/s 2024-09-21T07:18:49.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:49 smithi066 ceph-mon[34793]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 264 MiB/s wr, 683 op/s 2024-09-21T07:18:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:49 smithi029 ceph-mon[30983]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 264 MiB/s wr, 683 op/s 2024-09-21T07:18:51.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:51 smithi052 ceph-mon[34308]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 258 MiB/s wr, 693 op/s 2024-09-21T07:18:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:51 smithi066 ceph-mon[34793]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 258 MiB/s wr, 693 op/s 2024-09-21T07:18:51.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:51 smithi029 ceph-mon[30983]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 258 MiB/s wr, 693 op/s 2024-09-21T07:18:53.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:53 smithi052 ceph-mon[34308]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 269 MiB/s wr, 747 op/s 2024-09-21T07:18:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:53 smithi066 ceph-mon[34793]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 269 MiB/s wr, 747 op/s 2024-09-21T07:18:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:53 smithi029 ceph-mon[30983]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 269 MiB/s wr, 747 op/s 2024-09-21T07:18:55.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:55 smithi052 ceph-mon[34308]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 269 MiB/s wr, 773 op/s 2024-09-21T07:18:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:55 smithi066 ceph-mon[34793]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 269 MiB/s wr, 773 op/s 2024-09-21T07:18:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:55 smithi029 ceph-mon[30983]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 269 MiB/s wr, 773 op/s 2024-09-21T07:18:57.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:57 smithi052 ceph-mon[34308]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 251 MiB/s wr, 692 op/s 2024-09-21T07:18:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:57 smithi066 ceph-mon[34793]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 251 MiB/s wr, 692 op/s 2024-09-21T07:18:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:57 smithi029 ceph-mon[30983]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 251 MiB/s wr, 692 op/s 2024-09-21T07:18:59.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:18:59 smithi052 ceph-mon[34308]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 258 MiB/s wr, 762 op/s 2024-09-21T07:18:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:18:59 smithi066 ceph-mon[34793]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 258 MiB/s wr, 762 op/s 2024-09-21T07:18:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:18:59 smithi029 ceph-mon[30983]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 258 MiB/s wr, 762 op/s 2024-09-21T07:19:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:19:00.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:19:00.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:19:00.744 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:19:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:19:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:19:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:19:00.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:19:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:19:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:19:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:19:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:19:01.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:01 smithi052 ceph-mon[34308]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 235 MiB/s wr, 773 op/s 2024-09-21T07:19:01.772 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:01 smithi029 ceph-mon[30983]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 235 MiB/s wr, 773 op/s 2024-09-21T07:19:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:01 smithi066 ceph-mon[34793]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 235 MiB/s wr, 773 op/s 2024-09-21T07:19:03.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:03 smithi052 ceph-mon[34308]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 232 MiB/s wr, 848 op/s 2024-09-21T07:19:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:03 smithi066 ceph-mon[34793]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 232 MiB/s wr, 848 op/s 2024-09-21T07:19:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:03 smithi029 ceph-mon[30983]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 232 MiB/s wr, 848 op/s 2024-09-21T07:19:05.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:05 smithi052 ceph-mon[34308]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 222 MiB/s wr, 909 op/s 2024-09-21T07:19:05.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:05 smithi066 ceph-mon[34793]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 222 MiB/s wr, 909 op/s 2024-09-21T07:19:05.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:05 smithi029 ceph-mon[30983]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 222 MiB/s wr, 909 op/s 2024-09-21T07:19:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:07 smithi052 ceph-mon[34308]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 213 MiB/s wr, 916 op/s 2024-09-21T07:19:07.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:07 smithi066 ceph-mon[34793]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 213 MiB/s wr, 916 op/s 2024-09-21T07:19:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:07 smithi029 ceph-mon[30983]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 213 MiB/s wr, 916 op/s 2024-09-21T07:19:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:09 smithi052 ceph-mon[34308]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 226 MiB/s wr, 998 op/s 2024-09-21T07:19:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:09 smithi066 ceph-mon[34793]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 226 MiB/s wr, 998 op/s 2024-09-21T07:19:09.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:09 smithi029 ceph-mon[30983]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 226 MiB/s wr, 998 op/s 2024-09-21T07:19:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:11 smithi052 ceph-mon[34308]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 212 MiB/s wr, 865 op/s 2024-09-21T07:19:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:11 smithi066 ceph-mon[34793]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 212 MiB/s wr, 865 op/s 2024-09-21T07:19:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:11 smithi029 ceph-mon[30983]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 212 MiB/s wr, 865 op/s 2024-09-21T07:19:13.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:13 smithi052 ceph-mon[34308]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 223 MiB/s wr, 816 op/s 2024-09-21T07:19:13.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:13 smithi066 ceph-mon[34793]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 223 MiB/s wr, 816 op/s 2024-09-21T07:19:13.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:13 smithi029 ceph-mon[30983]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 223 MiB/s wr, 816 op/s 2024-09-21T07:19:15.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:15 smithi066 ceph-mon[34793]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 237 MiB/s wr, 761 op/s 2024-09-21T07:19:15.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:15 smithi029 ceph-mon[30983]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 237 MiB/s wr, 761 op/s 2024-09-21T07:19:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:15 smithi052 ceph-mon[34308]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 237 MiB/s wr, 761 op/s 2024-09-21T07:19:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:17 smithi066 ceph-mon[34793]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 229 MiB/s wr, 628 op/s 2024-09-21T07:19:17.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:17 smithi029 ceph-mon[30983]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 229 MiB/s wr, 628 op/s 2024-09-21T07:19:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:17 smithi052 ceph-mon[34308]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 229 MiB/s wr, 628 op/s 2024-09-21T07:19:19.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:19 smithi066 ceph-mon[34793]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 249 MiB/s wr, 558 op/s 2024-09-21T07:19:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:19 smithi029 ceph-mon[30983]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 249 MiB/s wr, 558 op/s 2024-09-21T07:19:19.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:19 smithi052 ceph-mon[34308]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 249 MiB/s wr, 558 op/s 2024-09-21T07:19:21.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:21 smithi066 ceph-mon[34793]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 236 MiB/s wr, 412 op/s 2024-09-21T07:19:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:21 smithi029 ceph-mon[30983]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 236 MiB/s wr, 412 op/s 2024-09-21T07:19:21.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:21 smithi052 ceph-mon[34308]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 236 MiB/s wr, 412 op/s 2024-09-21T07:19:23.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:23 smithi066 ceph-mon[34793]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 252 MiB/s wr, 418 op/s 2024-09-21T07:19:23.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:23 smithi029 ceph-mon[30983]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 252 MiB/s wr, 418 op/s 2024-09-21T07:19:23.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:23 smithi052 ceph-mon[34308]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 252 MiB/s wr, 418 op/s 2024-09-21T07:19:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:25 smithi052 ceph-mon[34308]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 265 MiB/s wr, 408 op/s 2024-09-21T07:19:25.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:25 smithi066 ceph-mon[34793]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 265 MiB/s wr, 408 op/s 2024-09-21T07:19:25.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:25 smithi029 ceph-mon[30983]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 265 MiB/s wr, 408 op/s 2024-09-21T07:19:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:27 smithi052 ceph-mon[34308]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 258 MiB/s wr, 341 op/s 2024-09-21T07:19:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:27 smithi066 ceph-mon[34793]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 258 MiB/s wr, 341 op/s 2024-09-21T07:19:27.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:27 smithi029 ceph-mon[30983]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 258 MiB/s wr, 341 op/s 2024-09-21T07:19:29.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:29 smithi052 ceph-mon[34308]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 285 MiB/s wr, 333 op/s 2024-09-21T07:19:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:29 smithi066 ceph-mon[34793]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 285 MiB/s wr, 333 op/s 2024-09-21T07:19:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:29 smithi029 ceph-mon[30983]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 285 MiB/s wr, 333 op/s 2024-09-21T07:19:31.676 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:31 smithi029 ceph-mon[30983]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 269 MiB/s wr, 299 op/s 2024-09-21T07:19:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:31 smithi052 ceph-mon[34308]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 269 MiB/s wr, 299 op/s 2024-09-21T07:19:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:31 smithi066 ceph-mon[34793]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 269 MiB/s wr, 299 op/s 2024-09-21T07:19:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:33 smithi052 ceph-mon[34308]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 281 MiB/s wr, 378 op/s 2024-09-21T07:19:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:33 smithi066 ceph-mon[34793]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 281 MiB/s wr, 378 op/s 2024-09-21T07:19:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:33 smithi029 ceph-mon[30983]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 281 MiB/s wr, 378 op/s 2024-09-21T07:19:35.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:35 smithi052 ceph-mon[34308]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 273 MiB/s wr, 448 op/s 2024-09-21T07:19:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:35 smithi066 ceph-mon[34793]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 273 MiB/s wr, 448 op/s 2024-09-21T07:19:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:35 smithi029 ceph-mon[30983]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 273 MiB/s wr, 448 op/s 2024-09-21T07:19:37.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:37 smithi052 ceph-mon[34308]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 258 MiB/s wr, 491 op/s 2024-09-21T07:19:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:37 smithi066 ceph-mon[34793]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 258 MiB/s wr, 491 op/s 2024-09-21T07:19:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:37 smithi029 ceph-mon[30983]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 258 MiB/s wr, 491 op/s 2024-09-21T07:19:39.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:39 smithi052 ceph-mon[34308]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 246 MiB/s wr, 514 op/s 2024-09-21T07:19:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:39 smithi066 ceph-mon[34793]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 246 MiB/s wr, 514 op/s 2024-09-21T07:19:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:39 smithi029 ceph-mon[30983]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 246 MiB/s wr, 514 op/s 2024-09-21T07:19:41.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:41 smithi052 ceph-mon[34308]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 221 MiB/s wr, 509 op/s 2024-09-21T07:19:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:41 smithi066 ceph-mon[34793]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 221 MiB/s wr, 509 op/s 2024-09-21T07:19:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:41 smithi029 ceph-mon[30983]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 221 MiB/s wr, 509 op/s 2024-09-21T07:19:43.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:43 smithi052 ceph-mon[34308]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 224 MiB/s wr, 510 op/s 2024-09-21T07:19:43.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:43 smithi066 ceph-mon[34793]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 224 MiB/s wr, 510 op/s 2024-09-21T07:19:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:43 smithi029 ceph-mon[30983]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 224 MiB/s wr, 510 op/s 2024-09-21T07:19:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:45 smithi066 ceph-mon[34793]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 224 MiB/s wr, 469 op/s 2024-09-21T07:19:45.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:45 smithi029 ceph-mon[30983]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 224 MiB/s wr, 469 op/s 2024-09-21T07:19:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:45 smithi052 ceph-mon[34308]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 224 MiB/s wr, 469 op/s 2024-09-21T07:19:47.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:47 smithi066 ceph-mon[34793]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 218 MiB/s wr, 454 op/s 2024-09-21T07:19:48.085 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:47 smithi052 ceph-mon[34308]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 218 MiB/s wr, 454 op/s 2024-09-21T07:19:48.086 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:47 smithi029 ceph-mon[30983]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 218 MiB/s wr, 454 op/s 2024-09-21T07:19:49.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:49 smithi066 ceph-mon[34793]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 224 MiB/s wr, 534 op/s 2024-09-21T07:19:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:49 smithi029 ceph-mon[30983]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 224 MiB/s wr, 534 op/s 2024-09-21T07:19:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:49 smithi052 ceph-mon[34308]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 224 MiB/s wr, 534 op/s 2024-09-21T07:19:51.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:51 smithi066 ceph-mon[34793]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 220 MiB/s wr, 626 op/s 2024-09-21T07:19:51.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:51 smithi029 ceph-mon[30983]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 220 MiB/s wr, 626 op/s 2024-09-21T07:19:51.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:51 smithi052 ceph-mon[34308]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 220 MiB/s wr, 626 op/s 2024-09-21T07:19:53.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:53 smithi066 ceph-mon[34793]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 228 MiB/s wr, 755 op/s 2024-09-21T07:19:53.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:53 smithi029 ceph-mon[30983]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 228 MiB/s wr, 755 op/s 2024-09-21T07:19:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:53 smithi052 ceph-mon[34308]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 228 MiB/s wr, 755 op/s 2024-09-21T07:19:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:55 smithi066 ceph-mon[34793]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 233 MiB/s wr, 896 op/s 2024-09-21T07:19:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:55 smithi029 ceph-mon[30983]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 233 MiB/s wr, 896 op/s 2024-09-21T07:19:55.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:55 smithi052 ceph-mon[34308]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 233 MiB/s wr, 896 op/s 2024-09-21T07:19:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:57 smithi066 ceph-mon[34793]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 244 MiB/s wr, 1.04k op/s 2024-09-21T07:19:57.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:57 smithi029 ceph-mon[30983]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 244 MiB/s wr, 1.04k op/s 2024-09-21T07:19:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:57 smithi052 ceph-mon[34308]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 244 MiB/s wr, 1.04k op/s 2024-09-21T07:19:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:19:59 smithi066 ceph-mon[34793]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 247 MiB/s wr, 1.11k op/s 2024-09-21T07:19:59.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:19:59 smithi029 ceph-mon[30983]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 247 MiB/s wr, 1.11k op/s 2024-09-21T07:19:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:19:59 smithi052 ceph-mon[34308]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 247 MiB/s wr, 1.11k op/s 2024-09-21T07:20:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:00 smithi029 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T07:20:00.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:00 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:20:00.969 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:00 smithi066 ceph-mon[34793]: overall HEALTH_OK 2024-09-21T07:20:00.969 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:00 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:20:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:00 smithi052 ceph-mon[34308]: overall HEALTH_OK 2024-09-21T07:20:00.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:00 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:20:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:01 smithi066 ceph-mon[34793]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 237 MiB/s wr, 1.12k op/s 2024-09-21T07:20:02.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:02.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:01 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:02.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:01 smithi029 ceph-mon[30983]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 237 MiB/s wr, 1.12k op/s 2024-09-21T07:20:02.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:02.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:01 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:02.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:01 smithi052 ceph-mon[34308]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 237 MiB/s wr, 1.12k op/s 2024-09-21T07:20:02.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:02.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:01 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:03 smithi029 ceph-mon[30983]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 244 MiB/s wr, 1.21k op/s 2024-09-21T07:20:03.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.238 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:03 smithi066 ceph-mon[34793]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 244 MiB/s wr, 1.21k op/s 2024-09-21T07:20:03.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:03 smithi052 ceph-mon[34308]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 244 MiB/s wr, 1.21k op/s 2024-09-21T07:20:03.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:03.494 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:20:04.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:20:04.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:20:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:20:04.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:04.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:20:04.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:20:04.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:20:05.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:05 smithi066 ceph-mon[34793]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 243 MiB/s wr, 1.20k op/s 2024-09-21T07:20:05.371 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:05 smithi029 ceph-mon[30983]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 243 MiB/s wr, 1.20k op/s 2024-09-21T07:20:05.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:05 smithi052 ceph-mon[34308]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 243 MiB/s wr, 1.20k op/s 2024-09-21T07:20:07.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:07 smithi052 ceph-mon[34308]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 232 MiB/s wr, 1.04k op/s 2024-09-21T07:20:07.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:07 smithi066 ceph-mon[34793]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 232 MiB/s wr, 1.04k op/s 2024-09-21T07:20:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:07 smithi029 ceph-mon[30983]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 232 MiB/s wr, 1.04k op/s 2024-09-21T07:20:09.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:09 smithi052 ceph-mon[34308]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 213 MiB/s wr, 803 op/s 2024-09-21T07:20:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:09 smithi066 ceph-mon[34793]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 213 MiB/s wr, 803 op/s 2024-09-21T07:20:09.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:09 smithi029 ceph-mon[30983]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 213 MiB/s wr, 803 op/s 2024-09-21T07:20:11.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:11 smithi052 ceph-mon[34308]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 205 MiB/s wr, 625 op/s 2024-09-21T07:20:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:11 smithi066 ceph-mon[34793]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 205 MiB/s wr, 625 op/s 2024-09-21T07:20:11.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:11 smithi029 ceph-mon[30983]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 205 MiB/s wr, 625 op/s 2024-09-21T07:20:13.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:13 smithi052 ceph-mon[34308]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 213 MiB/s wr, 467 op/s 2024-09-21T07:20:13.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:13 smithi066 ceph-mon[34793]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 213 MiB/s wr, 467 op/s 2024-09-21T07:20:13.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:13 smithi029 ceph-mon[30983]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 213 MiB/s wr, 467 op/s 2024-09-21T07:20:15.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:15 smithi052 ceph-mon[34308]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 221 MiB/s wr, 266 op/s 2024-09-21T07:20:15.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:15 smithi066 ceph-mon[34793]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 221 MiB/s wr, 266 op/s 2024-09-21T07:20:15.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:15 smithi029 ceph-mon[30983]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 221 MiB/s wr, 266 op/s 2024-09-21T07:20:17.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:17 smithi052 ceph-mon[34308]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 225 MiB/s wr, 208 op/s 2024-09-21T07:20:17.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:17 smithi066 ceph-mon[34793]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 225 MiB/s wr, 208 op/s 2024-09-21T07:20:17.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:17 smithi029 ceph-mon[30983]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 225 MiB/s wr, 208 op/s 2024-09-21T07:20:19.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:19 smithi052 ceph-mon[34308]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 226 MiB/s wr, 325 op/s 2024-09-21T07:20:19.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:19 smithi066 ceph-mon[34793]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 226 MiB/s wr, 325 op/s 2024-09-21T07:20:19.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:19 smithi029 ceph-mon[30983]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 226 MiB/s wr, 325 op/s 2024-09-21T07:20:21.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:21 smithi052 ceph-mon[34308]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 220 MiB/s wr, 462 op/s 2024-09-21T07:20:21.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:21 smithi066 ceph-mon[34793]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 220 MiB/s wr, 462 op/s 2024-09-21T07:20:21.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:21 smithi029 ceph-mon[30983]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 220 MiB/s wr, 462 op/s 2024-09-21T07:20:23.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:23 smithi052 ceph-mon[34308]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 224 MiB/s wr, 622 op/s 2024-09-21T07:20:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:23 smithi066 ceph-mon[34793]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 224 MiB/s wr, 622 op/s 2024-09-21T07:20:23.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:23 smithi029 ceph-mon[30983]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 224 MiB/s wr, 622 op/s 2024-09-21T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:25 smithi052 ceph-mon[34308]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 225 MiB/s wr, 814 op/s 2024-09-21T07:20:25.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:25 smithi066 ceph-mon[34793]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 225 MiB/s wr, 814 op/s 2024-09-21T07:20:25.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:25 smithi029 ceph-mon[30983]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 225 MiB/s wr, 814 op/s 2024-09-21T07:20:27.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:27 smithi052 ceph-mon[34308]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 221 MiB/s wr, 992 op/s 2024-09-21T07:20:27.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:27 smithi066 ceph-mon[34793]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 221 MiB/s wr, 992 op/s 2024-09-21T07:20:27.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:27 smithi029 ceph-mon[30983]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 221 MiB/s wr, 992 op/s 2024-09-21T07:20:29.746 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:29 smithi052 ceph-mon[34308]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 212 MiB/s wr, 1.05k op/s 2024-09-21T07:20:29.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:29 smithi066 ceph-mon[34793]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 212 MiB/s wr, 1.05k op/s 2024-09-21T07:20:29.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:29 smithi029 ceph-mon[30983]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 212 MiB/s wr, 1.05k op/s 2024-09-21T07:20:31.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:31 smithi052 ceph-mon[34308]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 205 MiB/s wr, 1.03k op/s 2024-09-21T07:20:31.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:31 smithi066 ceph-mon[34793]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 205 MiB/s wr, 1.03k op/s 2024-09-21T07:20:31.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:31 smithi029 ceph-mon[30983]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 205 MiB/s wr, 1.03k op/s 2024-09-21T07:20:33.743 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:33 smithi052 ceph-mon[34308]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 215 MiB/s wr, 1.07k op/s 2024-09-21T07:20:33.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:33 smithi066 ceph-mon[34793]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 215 MiB/s wr, 1.07k op/s 2024-09-21T07:20:33.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:33 smithi029 ceph-mon[30983]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 215 MiB/s wr, 1.07k op/s 2024-09-21T07:20:35.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:35 smithi066 ceph-mon[34793]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 222 MiB/s wr, 1.10k op/s 2024-09-21T07:20:35.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:35 smithi029 ceph-mon[30983]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 222 MiB/s wr, 1.10k op/s 2024-09-21T07:20:35.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:35 smithi052 ceph-mon[34308]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 222 MiB/s wr, 1.10k op/s 2024-09-21T07:20:37.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:37 smithi066 ceph-mon[34793]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 221 MiB/s wr, 1.02k op/s 2024-09-21T07:20:37.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:37 smithi029 ceph-mon[30983]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 221 MiB/s wr, 1.02k op/s 2024-09-21T07:20:37.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:37 smithi052 ceph-mon[34308]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 221 MiB/s wr, 1.02k op/s 2024-09-21T07:20:39.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:39 smithi066 ceph-mon[34793]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 210 MiB/s wr, 854 op/s 2024-09-21T07:20:39.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:39 smithi029 ceph-mon[30983]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 210 MiB/s wr, 854 op/s 2024-09-21T07:20:39.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:39 smithi052 ceph-mon[34308]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 210 MiB/s wr, 854 op/s 2024-09-21T07:20:41.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:41 smithi066 ceph-mon[34793]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 202 MiB/s wr, 705 op/s 2024-09-21T07:20:41.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:41 smithi029 ceph-mon[30983]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 202 MiB/s wr, 705 op/s 2024-09-21T07:20:41.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:41 smithi052 ceph-mon[34308]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 202 MiB/s wr, 705 op/s 2024-09-21T07:20:43.795 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:43 smithi052 ceph-mon[34308]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 212 MiB/s wr, 571 op/s 2024-09-21T07:20:43.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:43 smithi066 ceph-mon[34793]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 212 MiB/s wr, 571 op/s 2024-09-21T07:20:43.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:43 smithi029 ceph-mon[30983]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 212 MiB/s wr, 571 op/s 2024-09-21T07:20:45.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:45 smithi066 ceph-mon[34793]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 220 MiB/s wr, 414 op/s 2024-09-21T07:20:45.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:45 smithi029 ceph-mon[30983]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 220 MiB/s wr, 414 op/s 2024-09-21T07:20:45.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:45 smithi052 ceph-mon[34308]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 220 MiB/s wr, 414 op/s 2024-09-21T07:20:46.480 INFO:tasks.workunit.client.0.smithi029.stdout:stopping iogen 2024-09-21T07:20:46.480 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo 'stopping iogen' 2024-09-21T07:20:46.481 INFO:tasks.workunit.client.0.smithi029.stderr:+ ./iogen -k 2024-09-21T07:20:46.481 INFO:tasks.workunit.client.0.smithi029.stdout:OK 2024-09-21T07:20:46.481 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo OK 2024-09-21T07:20:47.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:47 smithi066 ceph-mon[34793]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 214 MiB/s wr, 354 op/s 2024-09-21T07:20:47.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:47 smithi029 ceph-mon[30983]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 214 MiB/s wr, 354 op/s 2024-09-21T07:20:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:47 smithi052 ceph-mon[34308]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 214 MiB/s wr, 354 op/s 2024-09-21T07:20:48.990 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T07:20:48.990 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T07:20:49.253 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-21T07:20:49.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T07:20:49.550 DEBUG:teuthology.parallel:result is None 2024-09-21T07:20:49.550 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:20:49.585 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T07:20:49.585 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T07:20:49.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.736+0000 7f8bb5c64640 1 -- 172.21.15.29:0/1015399404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 msgr2=0x7f8bb010ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.736+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/1015399404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb010ba80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009ca0 tx=0x7f8ba802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 -- 172.21.15.29:0/1015399404 shutdown_connections 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/1015399404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb010ba80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/1015399404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bb0104740 0x7f8bb0104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/1015399404 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb01036c0 0x7f8bb0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 -- 172.21.15.29:0/1015399404 >> 172.21.15.29:0/1015399404 conn(0x7f8bb00ff020 msgr2=0x7f8bb01014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 -- 172.21.15.29:0/1015399404 shutdown_connections 2024-09-21T07:20:49.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 -- 172.21.15.29:0/1015399404 wait complete. 2024-09-21T07:20:49.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 Processor -- start 2024-09-21T07:20:49.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.737+0000 7f8bb5c64640 1 -- start start 2024-09-21T07:20:49.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8bb5c64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb01036c0 0x7f8bb0199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8bb5c64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bb0104740 0x7f8bb019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8bb5c64640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8bb5c64640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb010f2f0 con 0x7f8bb01050e0 2024-09-21T07:20:49.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8bb5c64640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb010f170 con 0x7f8bb01036c0 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8bb5c64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb010f470 con 0x7f8bb0104740 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb019b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42250/0 (socket says 172.21.15.29:42250) 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 -- 172.21.15.29:0/3597479524 learned_addr learned my addr 172.21.15.29:0/3597479524 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baf7fe640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb01036c0 0x7f8bb0199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8ba6ffd640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bb0104740 0x7f8bb019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 -- 172.21.15.29:0/3597479524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bb0104740 msgr2=0x7f8bb019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bb0104740 0x7f8bb019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 -- 172.21.15.29:0/3597479524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb01036c0 msgr2=0x7f8bb0199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb01036c0 0x7f8bb0199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 -- 172.21.15.29:0/3597479524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb019b900 con 0x7f8bb01050e0 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.738+0000 7f8baffff640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb019b0e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097b0 tx=0x7f8ba8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.739+0000 7f8bad7fa640 1 -- 172.21.15.29:0/3597479524 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004240 con 0x7f8bb01050e0 2024-09-21T07:20:49.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.739+0000 7f8bad7fa640 1 -- 172.21.15.29:0/3597479524 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ba802f310 con 0x7f8bb01050e0 2024-09-21T07:20:49.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.739+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb019bb90 con 0x7f8bb01050e0 2024-09-21T07:20:49.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.739+0000 7f8bad7fa640 1 -- 172.21.15.29:0/3597479524 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba802fb50 con 0x7f8bb01050e0 2024-09-21T07:20:49.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.739+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb01a22e0 con 0x7f8bb01050e0 2024-09-21T07:20:49.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.740+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb010a890 con 0x7f8bb01050e0 2024-09-21T07:20:49.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.741+0000 7f8bad7fa640 1 -- 172.21.15.29:0/3597479524 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8ba802fd30 con 0x7f8bb01050e0 2024-09-21T07:20:49.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.742+0000 7f8bad7fa640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8b9c0b6590 0x7f8b9c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:49.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.742+0000 7f8baf7fe640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8b9c0b6590 0x7f8b9c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:49.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.742+0000 7f8bad7fa640 1 -- 172.21.15.29:0/3597479524 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f8ba81089d0 con 0x7f8bb01050e0 2024-09-21T07:20:49.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.743+0000 7f8baf7fe640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8b9c0b6590 0x7f8b9c0b8aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0005d00 tx=0x7f8ba0005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:49.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.745+0000 7f8bad7fa640 1 -- 172.21.15.29:0/3597479524 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ba80cf210 con 0x7f8bb01050e0 2024-09-21T07:20:49.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:49 smithi066 ceph-mon[34793]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 211 MiB/s wr, 434 op/s 2024-09-21T07:20:49.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:49 smithi029 ceph-mon[30983]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 211 MiB/s wr, 434 op/s 2024-09-21T07:20:49.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.939+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bb0063fc0 con 0x7f8bb01050e0 2024-09-21T07:20:49.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.940+0000 7f8bad7fa640 1 -- 172.21.15.29:0/3597479524 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22640 (secure 0 0 0) 0x7f8ba80d35f0 con 0x7f8bb01050e0 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:20:49.943 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":75,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:57.657853+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8b9c0b6590 msgr2=0x7f8b9c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8b9c0b6590 0x7f8b9c0b8aa0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0005d00 tx=0x7f8ba0005c50 comp rx=0 tx=0).stop 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 msgr2=0x7f8bb019b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb019b0e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80097b0 tx=0x7f8ba8003c20 comp rx=0 tx=0).stop 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 shutdown_connections 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f8b9c0b6590 0x7f8b9c0b8aa0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bb01050e0 0x7f8bb019b0e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bb0104740 0x7f8bb019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 --2- 172.21.15.29:0/3597479524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb01036c0 0x7f8bb0199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 >> 172.21.15.29:0/3597479524 conn(0x7f8bb00ff020 msgr2=0x7f8bb0107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 shutdown_connections 2024-09-21T07:20:49.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:49.943+0000 7f8bb5c64640 1 -- 172.21.15.29:0/3597479524 wait complete. 2024-09-21T07:20:49.957 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:02:52.375565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:07:28.778542+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:07:31.346462+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:20:49.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:20:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:49 smithi052 ceph-mon[34308]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 211 MiB/s wr, 434 op/s 2024-09-21T07:20:50.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 -- 172.21.15.29:0/3675250665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 msgr2=0x7fc82010a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 --2- 172.21.15.29:0/3675250665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc82010a950 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc818009ca0 tx=0x7fc81802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 -- 172.21.15.29:0/3675250665 shutdown_connections 2024-09-21T07:20:50.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 --2- 172.21.15.29:0/3675250665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc82010a950 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 --2- 172.21.15.29:0/3675250665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc820103610 0x7fc820103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 --2- 172.21.15.29:0/3675250665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc820102590 0x7fc820102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 -- 172.21.15.29:0/3675250665 >> 172.21.15.29:0/3675250665 conn(0x7fc8200fded0 msgr2=0x7fc820100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:50.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 -- 172.21.15.29:0/3675250665 shutdown_connections 2024-09-21T07:20:50.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.075+0000 7fc826920640 1 -- 172.21.15.29:0/3675250665 wait complete. 2024-09-21T07:20:50.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 Processor -- start 2024-09-21T07:20:50.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 -- start start 2024-09-21T07:20:50.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc820102590 0x7fc820198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc820103610 0x7fc820199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc820199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc82010e1f0 con 0x7fc820103fb0 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc82010e070 con 0x7fc820102590 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc826920640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc82010e370 con 0x7fc820103610 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc824ebd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc820199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc824ebd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc820199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42280/0 (socket says 172.21.15.29:42280) 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc824ebd640 1 -- 172.21.15.29:0/3881729729 learned_addr learned my addr 172.21.15.29:0/3881729729 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc81ffff640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc820102590 0x7fc820198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.076+0000 7fc81f7fe640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc820103610 0x7fc820199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc824ebd640 1 -- 172.21.15.29:0/3881729729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc820103610 msgr2=0x7fc820199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc824ebd640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc820103610 0x7fc820199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc824ebd640 1 -- 172.21.15.29:0/3881729729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc820102590 msgr2=0x7fc820198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc824ebd640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc820102590 0x7fc820198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc824ebd640 1 -- 172.21.15.29:0/3881729729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82019a7f0 con 0x7fc820103fb0 2024-09-21T07:20:50.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc824ebd640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc820199fd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc818006010 tx=0x7fc818003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:50.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc81d7fa640 1 -- 172.21.15.29:0/3881729729 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818004240 con 0x7fc820103fb0 2024-09-21T07:20:50.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc81d7fa640 1 -- 172.21.15.29:0/3881729729 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8180317e0 con 0x7fc820103fb0 2024-09-21T07:20:50.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc81d7fa640 1 -- 172.21.15.29:0/3881729729 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81802fac0 con 0x7fc820103fb0 2024-09-21T07:20:50.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82019aa80 con 0x7fc820103fb0 2024-09-21T07:20:50.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.077+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8201a11d0 con 0x7fc820103fb0 2024-09-21T07:20:50.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.078+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc820109740 con 0x7fc820103fb0 2024-09-21T07:20:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.080+0000 7fc81d7fa640 1 -- 172.21.15.29:0/3881729729 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc81802fc60 con 0x7fc820103fb0 2024-09-21T07:20:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.080+0000 7fc81d7fa640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc8080b6510 0x7fc8080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.081+0000 7fc81ffff640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc8080b6510 0x7fc8080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.081+0000 7fc81d7fa640 1 -- 172.21.15.29:0/3881729729 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc818108800 con 0x7fc820103fb0 2024-09-21T07:20:50.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.081+0000 7fc81ffff640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc8080b6510 0x7fc8080b8a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc810009bd0 tx=0x7fc810005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:50.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.084+0000 7fc81d7fa640 1 -- 172.21.15.29:0/3881729729 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8180cf0a0 con 0x7fc820103fb0 2024-09-21T07:20:50.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.271+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc820063fc0 con 0x7fc820103fb0 2024-09-21T07:20:50.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.271+0000 7fc81d7fa640 1 -- 172.21.15.29:0/3881729729 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7fc8180d3480 con 0x7fc820103fb0 2024-09-21T07:20:50.273 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-21T07:20:50.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc8080b6510 msgr2=0x7fc8080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc8080b6510 0x7fc8080b8a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc810009bd0 tx=0x7fc810005f90 comp rx=0 tx=0).stop 2024-09-21T07:20:50.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 msgr2=0x7fc820199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc820199fd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc818006010 tx=0x7fc818003c20 comp rx=0 tx=0).stop 2024-09-21T07:20:50.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 shutdown_connections 2024-09-21T07:20:50.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc8080b6510 0x7fc8080b8a20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc820103fb0 0x7fc820199fd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc820103610 0x7fc820199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 --2- 172.21.15.29:0/3881729729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc820102590 0x7fc820198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 >> 172.21.15.29:0/3881729729 conn(0x7fc8200fded0 msgr2=0x7fc820106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:50.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 shutdown_connections 2024-09-21T07:20:50.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.273+0000 7fc826920640 1 -- 172.21.15.29:0/3881729729 wait complete. 2024-09-21T07:20:50.287 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:20:50.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 -- 172.21.15.29:0/4113827773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb41050b0 msgr2=0x7f2fb410ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 --2- 172.21.15.29:0/4113827773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb41050b0 0x7f2fb410ba50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009ca0 tx=0x7f2fac02a8c0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 -- 172.21.15.29:0/4113827773 shutdown_connections 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 --2- 172.21.15.29:0/4113827773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb41050b0 0x7f2fb410ba50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 --2- 172.21.15.29:0/4113827773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fb4104710 0x7f2fb4104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 --2- 172.21.15.29:0/4113827773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb4103690 0x7f2fb4103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 -- 172.21.15.29:0/4113827773 >> 172.21.15.29:0/4113827773 conn(0x7f2fb40feff0 msgr2=0x7f2fb4101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 -- 172.21.15.29:0/4113827773 shutdown_connections 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.402+0000 7f2fba771640 1 -- 172.21.15.29:0/4113827773 wait complete. 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 Processor -- start 2024-09-21T07:20:50.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 -- start start 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb4103690 0x7f2fb4199e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fb4104710 0x7f2fb419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb41050b0 0x7f2fb419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb410f2c0 con 0x7f2fb4103690 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb410f140 con 0x7f2fb41050b0 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fba771640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb410f440 con 0x7f2fb4104710 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb4103690 0x7f2fb4199e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fb3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb4103690 0x7f2fb4199e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42298/0 (socket says 172.21.15.29:42298) 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.403+0000 7f2fb3fff640 1 -- 172.21.15.29:0/3828653802 learned_addr learned my addr 172.21.15.29:0/3828653802 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:20:50.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb37fe640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fb4104710 0x7f2fb419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb8d0e640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb41050b0 0x7f2fb419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb3fff640 1 -- 172.21.15.29:0/3828653802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fb4104710 msgr2=0x7f2fb419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb3fff640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fb4104710 0x7f2fb419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb3fff640 1 -- 172.21.15.29:0/3828653802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb41050b0 msgr2=0x7f2fb419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb3fff640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb41050b0 0x7f2fb419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb3fff640 1 -- 172.21.15.29:0/3828653802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb419b810 con 0x7f2fb4103690 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb8d0e640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb41050b0 0x7f2fb419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb3fff640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb4103690 0x7f2fb4199e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400e9f0 tx=0x7f2fa400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb17fa640 1 -- 172.21.15.29:0/3828653802 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa400ccc0 con 0x7f2fb4103690 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb17fa640 1 -- 172.21.15.29:0/3828653802 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fa40108e0 con 0x7f2fb4103690 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb419bb00 con 0x7f2fb4103690 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fb17fa640 1 -- 172.21.15.29:0/3828653802 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4018880 con 0x7f2fb4103690 2024-09-21T07:20:50.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.404+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb41a2280 con 0x7f2fb4103690 2024-09-21T07:20:50.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.405+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb4103b00 con 0x7f2fb4103690 2024-09-21T07:20:50.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.407+0000 7f2fb17fa640 1 -- 172.21.15.29:0/3828653802 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2fa4010430 con 0x7f2fb4103690 2024-09-21T07:20:50.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.408+0000 7f2fb17fa640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2f9c0b6510 0x7f2f9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.408+0000 7f2fb37fe640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2f9c0b6510 0x7f2f9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.408+0000 7f2fb17fa640 1 -- 172.21.15.29:0/3828653802 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f2fa40e77a0 con 0x7f2fb4103690 2024-09-21T07:20:50.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.408+0000 7f2fb37fe640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2f9c0b6510 0x7f2f9c0b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800abe0 tx=0x7f2fa800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:50.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.413+0000 7f2fb17fa640 1 -- 172.21.15.29:0/3828653802 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fa40ae040 con 0x7f2fb4103690 2024-09-21T07:20:50.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.606+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2fb402e640 con 0x7f2fb4103690 2024-09-21T07:20:50.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.606+0000 7f2fb17fa640 1 -- 172.21.15.29:0/3828653802 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f2fa40b2420 con 0x7f2fb4103690 2024-09-21T07:20:50.608 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2f9c0b6510 msgr2=0x7f2f9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2f9c0b6510 0x7f2f9c0b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800abe0 tx=0x7f2fa800a2d0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb4103690 msgr2=0x7f2fb4199e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb4103690 0x7f2fb4199e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400e9f0 tx=0x7f2fa400edf0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 shutdown_connections 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f2f9c0b6510 0x7f2f9c0b8a20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb41050b0 0x7f2fb419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2fb4104710 0x7f2fb419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 --2- 172.21.15.29:0/3828653802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fb4103690 0x7f2fb4199e60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 >> 172.21.15.29:0/3828653802 conn(0x7f2fb40feff0 msgr2=0x7f2fb4107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:50.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 shutdown_connections 2024-09-21T07:20:50.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.609+0000 7f2fba771640 1 -- 172.21.15.29:0/3828653802 wait complete. 2024-09-21T07:20:50.622 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:20:50.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 -- 172.21.15.29:0/3949642348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4102590 msgr2=0x7f81e4102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/3949642348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4102590 0x7f81e4102a00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009900 tx=0x7f81d402a410 comp rx=0 tx=0).stop 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 -- 172.21.15.29:0/3949642348 shutdown_connections 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/3949642348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81e4103fb0 0x7f81e410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/3949642348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e4103610 0x7f81e4103a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/3949642348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4102590 0x7f81e4102a00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 -- 172.21.15.29:0/3949642348 >> 172.21.15.29:0/3949642348 conn(0x7f81e40fded0 msgr2=0x7f81e4100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 -- 172.21.15.29:0/3949642348 shutdown_connections 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 -- 172.21.15.29:0/3949642348 wait complete. 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 Processor -- start 2024-09-21T07:20:50.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.738+0000 7f81ea6bd640 1 -- start start 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81ea6bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e4102590 0x7f81e4199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81ea6bd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4103610 0x7f81e419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81ea6bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81e4103fb0 0x7f81e419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81ea6bd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f81e410e1e0 con 0x7f81e4103610 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81ea6bd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81e410e060 con 0x7f81e4102590 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81ea6bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81e410e360 con 0x7f81e4103fb0 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4103610 0x7f81e419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4103610 0x7f81e419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42310/0 (socket says 172.21.15.29:42310) 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 -- 172.21.15.29:0/1821975999 learned_addr learned my addr 172.21.15.29:0/1821975999 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:20:50.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e3fff640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e4102590 0x7f81e4199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e8c5a640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81e4103fb0 0x7f81e419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 -- 172.21.15.29:0/1821975999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81e4103fb0 msgr2=0x7f81e419b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81e4103fb0 0x7f81e419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 -- 172.21.15.29:0/1821975999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e4102590 msgr2=0x7f81e4199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e4102590 0x7f81e4199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.739+0000 7f81e37fe640 1 -- 172.21.15.29:0/1821975999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e419b940 con 0x7f81e4103610 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.740+0000 7f81e37fe640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4103610 0x7f81e419a570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f81d800d950 tx=0x7f81d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.740+0000 7f81e17fa640 1 -- 172.21.15.29:0/1821975999 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8017030 con 0x7f81e4103610 2024-09-21T07:20:50.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.740+0000 7f81e17fa640 1 -- 172.21.15.29:0/1821975999 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81d8004020 con 0x7f81e4103610 2024-09-21T07:20:50.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.740+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e419bc30 con 0x7f81e4103610 2024-09-21T07:20:50.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.740+0000 7f81e17fa640 1 -- 172.21.15.29:0/1821975999 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80047a0 con 0x7f81e4103610 2024-09-21T07:20:50.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.740+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e41a2320 con 0x7f81e4103610 2024-09-21T07:20:50.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.741+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e41a2550 con 0x7f81e4103610 2024-09-21T07:20:50.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.743+0000 7f81e17fa640 1 -- 172.21.15.29:0/1821975999 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f81d8009a30 con 0x7f81e4103610 2024-09-21T07:20:50.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.743+0000 7f81e17fa640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f81cc0b6590 0x7f81cc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:50.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.743+0000 7f81e3fff640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f81cc0b6590 0x7f81cc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:50.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.744+0000 7f81e17fa640 1 -- 172.21.15.29:0/1821975999 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f81d80e73a0 con 0x7f81e4103610 2024-09-21T07:20:50.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.744+0000 7f81e3fff640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f81cc0b6590 0x7f81cc0b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81d4000c00 tx=0x7f81d4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:50.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.746+0000 7f81e17fa640 1 -- 172.21.15.29:0/1821975999 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81d80adcc0 con 0x7f81e4103610 2024-09-21T07:20:50.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:50 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3597479524' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:20:50.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:50 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3881729729' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:20:50.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:50 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3597479524' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:20:50.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:50 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3881729729' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:20:50.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.936+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f81e41a2720 con 0x7f81e4103610 2024-09-21T07:20:50.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.937+0000 7f81e17fa640 1 -- 172.21.15.29:0/1821975999 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f81d80b20a0 con 0x7f81e4103610 2024-09-21T07:20:50.939 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f81cc0b6590 msgr2=0x7f81cc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f81cc0b6590 0x7f81cc0b8aa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81d4000c00 tx=0x7f81d4031400 comp rx=0 tx=0).stop 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4103610 msgr2=0x7f81e419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4103610 0x7f81e419a570 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f81d800d950 tx=0x7f81d800de10 comp rx=0 tx=0).stop 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 shutdown_connections 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f81cc0b6590 0x7f81cc0b8aa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81e4103fb0 0x7f81e419b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4103610 0x7f81e419a570 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 --2- 172.21.15.29:0/1821975999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81e4102590 0x7f81e4199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:50.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 >> 172.21.15.29:0/1821975999 conn(0x7f81e40fded0 msgr2=0x7f81e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:50.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 shutdown_connections 2024-09-21T07:20:50.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:50.939+0000 7f81ea6bd640 1 -- 172.21.15.29:0/1821975999 wait complete. 2024-09-21T07:20:50.952 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T07:20:50.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:50 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3597479524' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:20:50.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:50 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3881729729' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T07:20:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 -- 172.21.15.29:0/2107742462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90101ab0 msgr2=0x7f6a90101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 --2- 172.21.15.29:0/2107742462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90101ab0 0x7f6a90101ec0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009900 tx=0x7f6a8002a410 comp rx=0 tx=0).stop 2024-09-21T07:20:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 -- 172.21.15.29:0/2107742462 shutdown_connections 2024-09-21T07:20:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 --2- 172.21.15.29:0/2107742462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a90109560 0x7f6a9010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 --2- 172.21.15.29:0/2107742462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a90106c00 0x7f6a90109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 --2- 172.21.15.29:0/2107742462 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90101ab0 0x7f6a90101ec0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 -- 172.21.15.29:0/2107742462 >> 172.21.15.29:0/2107742462 conn(0x7f6a900fd690 msgr2=0x7f6a900ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 -- 172.21.15.29:0/2107742462 shutdown_connections 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 -- 172.21.15.29:0/2107742462 wait complete. 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.065+0000 7f6a95ece640 1 Processor -- start 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a95ece640 1 -- start start 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a95ece640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a90101ab0 0x7f6a90199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a95ece640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a90106c00 0x7f6a9019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a95ece640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90109560 0x7f6a9019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a95ece640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9010f300 con 0x7f6a90109560 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a95ece640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9010f180 con 0x7f6a90106c00 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a95ece640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9010f480 con 0x7f6a90101ab0 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90109560 0x7f6a9019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90109560 0x7f6a9019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42334/0 (socket says 172.21.15.29:42334) 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 -- 172.21.15.29:0/3275316440 learned_addr learned my addr 172.21.15.29:0/3275316440 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8f7fe640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a90101ab0 0x7f6a90199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8effd640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a90106c00 0x7f6a9019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 -- 172.21.15.29:0/3275316440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a90101ab0 msgr2=0x7f6a90199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a90101ab0 0x7f6a90199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 -- 172.21.15.29:0/3275316440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a90106c00 msgr2=0x7f6a9019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a90106c00 0x7f6a9019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8ffff640 1 -- 172.21.15.29:0/3275316440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9019b9a0 con 0x7f6a90109560 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.066+0000 7f6a8effd640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a90106c00 0x7f6a9019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.067+0000 7f6a8ffff640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90109560 0x7f6a9019b180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009fd0 tx=0x7f6a8800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.067+0000 7f6a8cff9640 1 -- 172.21.15.29:0/3275316440 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88017070 con 0x7f6a90109560 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.067+0000 7f6a8cff9640 1 -- 172.21.15.29:0/3275316440 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a88003e20 con 0x7f6a90109560 2024-09-21T07:20:51.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.067+0000 7f6a8cff9640 1 -- 172.21.15.29:0/3275316440 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88010460 con 0x7f6a90109560 2024-09-21T07:20:51.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.067+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9019bc90 con 0x7f6a90109560 2024-09-21T07:20:51.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.067+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a901a2380 con 0x7f6a90109560 2024-09-21T07:20:51.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.068+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a900ff1b0 con 0x7f6a90109560 2024-09-21T07:20:51.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.070+0000 7f6a8cff9640 1 -- 172.21.15.29:0/3275316440 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6a88003970 con 0x7f6a90109560 2024-09-21T07:20:51.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.071+0000 7f6a8cff9640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a7c0b6510 0x7f6a7c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:20:51.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.071+0000 7f6a8f7fe640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a7c0b6510 0x7f6a7c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:20:51.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.071+0000 7f6a8cff9640 1 -- 172.21.15.29:0/3275316440 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f6a880e6fd0 con 0x7f6a90109560 2024-09-21T07:20:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.071+0000 7f6a8f7fe640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a7c0b6510 0x7f6a7c0b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000c00 tx=0x7f6a80031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:20:51.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.074+0000 7f6a8cff9640 1 -- 172.21.15.29:0/3275316440 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a880ad910 con 0x7f6a90109560 2024-09-21T07:20:51.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.314+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f6a90063fc0 con 0x7f6a90109560 2024-09-21T07:20:51.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.323+0000 7f6a8cff9640 1 -- 172.21.15.29:0/3275316440 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+833521 (secure 0 0 0) 0x7f6a880b1cf0 con 0x7f6a90109560 2024-09-21T07:20:51.335 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:20:51.335 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:20:51.335 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-09-21T07:20:51.335 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.335 INFO:teuthology.orchestra.run.smithi029.stdout: "active_gid": 14152, 2024-09-21T07:20:51.335 INFO:teuthology.orchestra.run.smithi029.stdout: "active_name": "x", 2024-09-21T07:20:51.335 INFO:teuthology.orchestra.run.smithi029.stdout: "active_addrs": { 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 4201921978 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 4201921978 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:51.336 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "active_addr": "172.21.15.29:6801/4201921978", 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "active_change": "2024-09-21T06:59:55.886638+0000", 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "available": true, 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "standbys": [ 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "gid": 24127, 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "z", 2024-09-21T07:20:51.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "available_modules": [ 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "alerts", 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.338 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.339 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.340 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.341 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.343 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.344 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.345 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_destination": { 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_destination", 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.346 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_from_name": { 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_from_name", 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "Ceph", 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.347 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email From: name", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_host": { 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_host", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.348 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP server", 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_password": { 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_password", 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.349 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Password to authenticate with", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_port": { 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_port", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.350 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "465", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP port", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_sender": { 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_sender", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.351 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_ssl": { 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_ssl", 2024-09-21T07:20:51.352 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_user": { 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_user", 2024-09-21T07:20:51.353 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "User to authenticate as", 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.354 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.355 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "balancer", 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "active": { 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "active", 2024-09-21T07:20:51.356 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_time": { 2024-09-21T07:20:51.357 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_time", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0000", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.358 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_weekday": { 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_weekday", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_max_iterations": { 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "25", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "250", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.360 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_metrics": { 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_metrics", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.361 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_step": { 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_step", 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.5", 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0.001", 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "0.999", 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:20:51.362 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "end_time": { 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_time", 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2359", 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.363 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "end_weekday": { 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_weekday", 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.364 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.365 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.365 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.365 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-21T07:20:51.365 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-21T07:20:51.365 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.365 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:20:51.365 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:20:51.366 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.366 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.366 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.366 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.366 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.366 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.367 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.368 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.369 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.370 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.371 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "min_score": { 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_score", 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.372 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "upmap", 2024-09-21T07:20:51.373 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-compat", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "none", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "read", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap-read" 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Balancer mode", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.374 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_ids": { 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_ids", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.375 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.376 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.377 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.377 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.377 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.377 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.377 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.377 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.378 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.378 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.378 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.378 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.378 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.378 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.379 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.379 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.379 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.379 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.379 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_deviation": { 2024-09-21T07:20:51.379 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_deviation", 2024-09-21T07:20:51.380 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.380 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.380 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.380 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:51.380 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:51.380 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.380 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.381 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:20:51.381 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:20:51.381 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.381 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.381 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.381 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_optimizations": { 2024-09-21T07:20:51.381 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:20:51.382 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.382 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.382 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.382 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.382 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.382 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.382 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.383 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:20:51.383 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.383 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.383 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.383 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.383 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.383 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.384 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.384 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm", 2024-09-21T07:20:51.384 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.384 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.384 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.384 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_down_multiplier": { 2024-09-21T07:20:51.384 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_down_multiplier", 2024-09-21T07:20:51.385 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.385 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.385 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.385 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-21T07:20:51.385 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.385 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.385 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.386 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:20:51.386 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.386 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.386 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.386 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.387 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_refresh_rate": { 2024-09-21T07:20:51.387 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_refresh_rate", 2024-09-21T07:20:51.387 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.387 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.387 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.387 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "20", 2024-09-21T07:20:51.388 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.388 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.388 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.388 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:20:51.388 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.388 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.388 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.389 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.389 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_starting_port": { 2024-09-21T07:20:51.389 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_starting_port", 2024-09-21T07:20:51.389 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.389 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.389 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.390 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4721", 2024-09-21T07:20:51.390 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.390 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.390 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.390 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:20:51.390 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.390 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_ptrace": { 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_ptrace", 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.391 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.392 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.392 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.392 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.392 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:20:51.392 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:20:51.392 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.392 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.393 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.393 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_interval": { 2024-09-21T07:20:51.393 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_interval", 2024-09-21T07:20:51.393 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.393 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.394 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.394 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.394 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.394 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.394 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.394 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:20:51.395 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.395 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.395 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.395 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.395 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:20:51.395 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.7", 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.396 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_log_destination": { 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm_log_destination", 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.397 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "file", 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "file,syslog", 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "syslog" 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:20:51.398 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.399 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.399 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.399 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.399 INFO:teuthology.orchestra.run.smithi029.stdout: "cgroups_split": { 2024-09-21T07:20:51.399 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cgroups_split", 2024-09-21T07:20:51.399 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.399 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.400 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.400 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.400 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.400 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.400 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.400 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:20:51.400 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.401 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.401 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.401 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.401 INFO:teuthology.orchestra.run.smithi029.stdout: "config_checks_enabled": { 2024-09-21T07:20:51.401 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_checks_enabled", 2024-09-21T07:20:51.401 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.401 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.402 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.402 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.402 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.402 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.402 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.402 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "config_dashboard": { 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_dashboard", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.403 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_alertmanager": { 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_alertmanager", 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_base": { 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_base", 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.405 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_elasticsearch": { 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:20:51.406 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "elasticsearch container image", 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.407 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_grafana": { 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_grafana", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.408 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_haproxy": { 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_haproxy", 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "HAproxy container image", 2024-09-21T07:20:51.409 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_agent": { 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.410 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_collector": { 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.411 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_query": { 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:20:51.412 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.413 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.413 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.413 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger query container image", 2024-09-21T07:20:51.413 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.413 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.413 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_keepalived": { 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_keepalived", 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.414 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Keepalived container image", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_loki": { 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_loki", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.415 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Loki container image", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nginx": { 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nginx", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nginx container image", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_node_exporter": { 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_node_exporter", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.417 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nvmeof": { 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nvmeof", 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.418 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nvme-of container image", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.419 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.420 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.420 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:20:51.420 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.420 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.420 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.420 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.420 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_prometheus": { 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_prometheus", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.421 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_promtail": { 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_promtail", 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.422 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Promtail container image", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba": { 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.423 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba_metrics": { 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.424 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_snmp_gateway": { 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.425 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "container_init": { 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_init", 2024-09-21T07:20:51.426 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "daemon_cache_timeout": { 2024-09-21T07:20:51.427 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:20:51.428 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "900", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.429 INFO:teuthology.orchestra.run.smithi029.stdout: "default_registry": { 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_registry", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.430 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "device_cache_timeout": { 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_cache_timeout", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1800", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.431 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "device_enhanced_scan": { 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_enhanced_scan", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.432 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "facts_cache_timeout": { 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "facts_cache_timeout", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.433 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "grafana_dashboards_path": { 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.434 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "host_check_interval": { 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "host_check_interval", 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.435 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "hw_monitoring": { 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hw_monitoring", 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.436 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "inventory_list_all": { 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "inventory_list_all", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.437 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.438 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.439 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "log_refresh_metadata": { 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_refresh_metadata", 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.440 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.441 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.442 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.443 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.444 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.445 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:20:51.446 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "*", 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "max_count_per_host": { 2024-09-21T07:20:51.447 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_count_per_host", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd_draining_count": { 2024-09-21T07:20:51.448 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_osd_draining_count", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.449 INFO:teuthology.orchestra.run.smithi029.stdout: "migration_current": { 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "migration_current", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "internal - do not modify", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "root", 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.451 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm-package", 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "root" 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "oob_default_addr": { 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "oob_default_addr", 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.452 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "169.254.1.1", 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "prometheus_alerts_path": { 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.453 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_insecure": { 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_insecure", 2024-09-21T07:20:51.454 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:20:51.455 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_password": { 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_password", 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.456 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_url": { 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_url", 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.457 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.458 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_username": { 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_username", 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:20:51.459 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "secure_monitoring_stack": { 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.460 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "service_discovery_port": { 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "service_discovery_port", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8765", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.461 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.462 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_config_file": { 2024-09-21T07:20:51.463 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_config_file", 2024-09-21T07:20:51.464 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.464 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.464 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.464 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.464 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.464 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.465 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.465 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:20:51.465 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.465 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.465 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.465 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.465 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:20:51.466 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:20:51.466 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.466 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.466 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.466 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-21T07:20:51.466 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.466 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_keepalive_interval": { 2024-09-21T07:20:51.467 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.468 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "use_agent": { 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_agent", 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.469 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "use_repo_digest": { 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_repo_digest", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.470 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_failed_host_check": { 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.471 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_daemons": { 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:20:51.472 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.473 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_hosts": { 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:20:51.474 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crash", 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.476 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.477 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.478 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.479 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.480 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "retain_interval": { 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retain_interval", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "31536000", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.481 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.482 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_recent_interval": { 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_recent_interval", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1209600", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.483 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dashboard", 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:20:51.484 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:20:51.485 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.486 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.487 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.488 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.489 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.490 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.491 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.492 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.492 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.492 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.492 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.493 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.493 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:20:51.493 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:20:51.493 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.494 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.495 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:20:51.496 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:20:51.496 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.497 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.497 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.498 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.498 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.498 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.498 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.498 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.499 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.499 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.499 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.499 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.499 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:20:51.499 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:20:51.499 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.500 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.501 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.502 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.503 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.504 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:20:51.505 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.506 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_URL": { 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.507 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.508 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.509 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.510 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.510 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.510 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.510 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.510 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.511 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.511 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:20:51.511 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:20:51.511 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.511 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.511 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.512 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.512 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.512 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.512 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.512 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.512 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.513 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.514 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.514 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.514 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.514 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.514 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.514 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:20:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:20:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.515 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.516 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.516 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.516 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.516 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.516 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.516 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.516 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.517 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.518 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "[]", 2024-09-21T07:20:51.518 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.518 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.518 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.518 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.518 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.519 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.519 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.519 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.519 INFO:teuthology.orchestra.run.smithi029.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:20:51.519 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:20:51.519 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.519 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.520 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.520 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "{}", 2024-09-21T07:20:51.520 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.520 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.520 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.520 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.521 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.521 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.521 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.521 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.521 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:20:51.521 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:20:51.522 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.522 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.522 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.522 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.522 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.522 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:20:51.523 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.524 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.525 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.526 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.526 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.526 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.526 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.526 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.526 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.526 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.527 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.527 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:20:51.527 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:20:51.527 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.527 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.527 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.528 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.528 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.528 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.528 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.528 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.528 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.528 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.529 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.530 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.531 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.532 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.533 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.534 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.535 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.536 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:20:51.537 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.538 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "45", 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.539 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.540 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.541 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:20:51.542 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.543 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.544 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.545 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.546 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.547 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.548 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "cross_origin_url": { 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cross_origin_url", 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.549 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "crt_file": { 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crt_file", 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.550 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "debug": { 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "debug", 2024-09-21T07:20:51.551 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.552 INFO:teuthology.orchestra.run.smithi029.stdout: "jwt_token_ttl": { 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "jwt_token_ttl", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "28800", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.553 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.554 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.555 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.556 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.557 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.558 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "motd": { 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "motd", 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.560 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "The message of the day", 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.561 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:51.562 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:51.563 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8080", 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.564 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.565 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.566 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl_server_port": { 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl_server_port", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8443", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.567 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "sso_oauth2": { 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sso_oauth2", 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.568 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "redirect", 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.569 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect" 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.570 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.571 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "url_prefix": { 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url_prefix", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.572 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_monitoring": { 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_monitoring", 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.573 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "monitor device health metrics", 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.574 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.575 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.576 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.577 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.578 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.579 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "mark_out_threshold": { 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mark_out_threshold", 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2419200", 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.580 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": { 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_name", 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.581 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "device_health_metrics", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "retention_period": { 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retention_period", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.582 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15552000", 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_frequency": { 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_frequency", 2024-09-21T07:20:51.583 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "self_heal": { 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "self_heal", 2024-09-21T07:20:51.584 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:51.585 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.586 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_threshold": { 2024-09-21T07:20:51.587 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_threshold", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7257600", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.588 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "diskprediction_local", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.589 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.590 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.591 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.592 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.593 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "predict_interval": { 2024-09-21T07:20:51.594 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predict_interval", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.595 INFO:teuthology.orchestra.run.smithi029.stdout: "predictor_model": { 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predictor_model", 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "prophetstor", 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.596 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.597 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.597 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.597 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.597 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.597 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.597 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:51.597 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:51.598 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.598 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.598 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.598 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.598 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.598 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.599 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.599 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.599 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.599 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.599 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.599 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.599 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.600 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.601 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.601 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.601 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.601 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.601 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.601 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.601 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.602 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.602 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "influx", 2024-09-21T07:20:51.602 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": false, 2024-09-21T07:20:51.602 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:20:51.602 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.602 INFO:teuthology.orchestra.run.smithi029.stdout: "batch_size": { 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "batch_size", 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5000", 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.603 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "database": { 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "database", 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "ceph", 2024-09-21T07:20:51.604 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": { 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hostname", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.605 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:51.606 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "30", 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "5", 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.607 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.608 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.609 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.610 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.611 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.612 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "password": { 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "password", 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.613 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "port": { 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "port", 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8086", 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.614 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server port", 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.615 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.616 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "false", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "threads": { 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threads", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.617 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "32", 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "username": { 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "username", 2024-09-21T07:20:51.618 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "verify_ssl": { 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "verify_ssl", 2024-09-21T07:20:51.619 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "true", 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.620 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "insights", 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.621 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.622 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.622 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.622 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.622 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.622 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.622 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.622 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.623 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.624 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.625 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.626 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.627 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "iostat", 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.628 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.629 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.630 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.631 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.632 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.633 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.634 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "k8sevents", 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_event_retention_days": { 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-21T07:20:51.635 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "config_check_secs": { 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_check_secs", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.636 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "10", 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.637 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.638 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.639 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.640 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.641 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.642 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.643 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "localpool", 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.644 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "failure_domain": { 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "failure_domain", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "host", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.645 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.646 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.647 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.648 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.649 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.650 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": { 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_size", 2024-09-21T07:20:51.651 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "num_rep": { 2024-09-21T07:20:51.652 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "num_rep", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.653 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": { 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_num", 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "128", 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.654 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "prefix": { 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prefix", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.655 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.656 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "subtree": { 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "subtree", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "rack", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.657 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mds_autoscaler", 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.658 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.659 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.660 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.661 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.662 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.663 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.664 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.665 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirroring", 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.666 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.667 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.668 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.669 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.670 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.671 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.672 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "nfs", 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.673 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.674 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.675 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.676 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.677 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.678 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.679 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.680 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "fail_fs": { 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "fail_fs", 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.681 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.682 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.683 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.684 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.685 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.686 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator": { 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.687 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "rook", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "test_orchestrator" 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Orchestrator backend", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.688 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.689 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_perf_query", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.690 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.691 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.692 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.693 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.694 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.695 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.696 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_support", 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.697 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.698 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.699 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.700 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.701 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.702 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_autoscaler", 2024-09-21T07:20:51.703 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.704 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.705 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.706 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.707 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.708 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.710 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.711 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "threshold": { 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threshold", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1.0", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.712 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "scaling threshold", 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "progress", 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.713 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_pg_recovery_event": { 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.714 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.715 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.716 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.717 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.718 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.719 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.720 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "max_completed_events": { 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_completed_events", 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "50", 2024-09-21T07:20:51.721 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:51.722 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.723 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus", 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.724 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "cache": { 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cache", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.725 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "exclude_perf_counters": { 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "exclude_perf_counters", 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.726 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.727 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.728 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.729 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.730 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.731 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.732 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools": { 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.733 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "300", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.734 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_interval": { 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_interval", 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15.0", 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.735 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.736 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.737 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "9283", 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.738 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.739 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "stale_cache_strategy": { 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stale_cache_strategy", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "log", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.740 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "default", 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "default", 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: "error" 2024-09-21T07:20:51.741 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:51.742 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-21T07:20:51.743 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.744 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.745 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.746 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.747 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.748 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_snap_create": { 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.749 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.750 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.751 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "trash_purge_schedule": { 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "trash_purge_schedule", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.752 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "restful", 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_auth": { 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_auth", 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.753 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-21T07:20:51.754 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.755 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.756 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.757 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.758 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.759 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "max_requests": { 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_requests", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.760 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.761 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.762 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.763 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.764 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rgw", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.765 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.766 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.767 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.768 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.769 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:20:51.770 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.771 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.772 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rook", 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.773 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.774 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.775 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.776 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.777 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.777 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.777 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.777 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.777 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.777 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.777 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.778 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.778 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.778 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.778 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.778 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.778 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.778 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.779 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.779 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.779 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.779 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.779 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.779 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.780 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.781 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.782 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_class": { 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "storage_class", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "local", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.783 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "selftest", 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.784 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.785 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.786 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.787 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.788 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.789 INFO:teuthology.orchestra.run.smithi029.stdout: "roption1": { 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption1", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.790 INFO:teuthology.orchestra.run.smithi029.stdout: "roption2": { 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption2", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "xyz", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.791 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption1": { 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption1", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.792 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption2": { 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption2", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption3": { 2024-09-21T07:20:51.793 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption3", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.794 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption4": { 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption4", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption5": { 2024-09-21T07:20:51.795 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption5", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption6": { 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption6", 2024-09-21T07:20:51.796 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption7": { 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption7", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.797 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "42", 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.798 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.799 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "testkey": { 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testkey", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.800 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "testlkey": { 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testlkey", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.801 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "testnewline": { 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testnewline", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.802 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smb", 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "internal_store_backend": { 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "internal_store_backend", 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.803 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.804 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.805 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.806 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.807 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.808 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.809 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.810 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "update_orchestration": { 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "update_orchestration", 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.811 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.812 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snap_schedule", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_m_granularity": { 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_m_granularity", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.813 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "dump_on_update": { 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dump_on_update", 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.814 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.815 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.816 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.817 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.818 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.819 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.820 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.821 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stats", 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.822 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.823 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.824 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.825 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.826 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.827 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.828 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "status", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.829 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.830 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.831 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.832 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.833 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.834 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.835 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telegraf", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "address": { 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "address", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.836 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15", 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.837 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.838 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.839 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.840 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.841 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.842 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.843 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.844 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telemetry", 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_basic": { 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_basic", 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.845 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_crash": { 2024-09-21T07:20:51.846 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_crash", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_device": { 2024-09-21T07:20:51.847 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_device", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.848 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_ident": { 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_ident", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_perf": { 2024-09-21T07:20:51.849 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_perf", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.850 INFO:teuthology.orchestra.run.smithi029.stdout: "contact": { 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "contact", 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.851 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "description": { 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "description", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.852 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "device_url": { 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_url", 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.853 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.854 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "24", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "8", 2024-09-21T07:20:51.855 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "last_opt_revision": { 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "last_opt_revision", 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.856 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard": { 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.857 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard_description": { 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard_description", 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.858 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.859 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.860 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.861 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.862 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.863 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.864 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "organization": { 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "organization", 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.865 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "proxy": { 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "proxy", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.866 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.867 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "url": { 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url", 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.868 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "test_orchestrator", 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.869 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.870 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.872 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.872 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.872 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.872 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.872 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.872 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.872 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.873 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.874 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.875 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.876 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.877 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.878 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.879 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.880 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.881 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.882 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.883 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_clones": { 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_clones", 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4", 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:20:51.884 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "periodic_async_work": { 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "periodic_async_work", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Periodically check for async work", 2024-09-21T07:20:51.885 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_delay": { 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.886 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.887 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.888 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.889 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix", 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "discovery_interval": { 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "discovery_interval", 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "100", 2024-09-21T07:20:51.890 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "identifier": { 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "identifier", 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.891 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.892 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.893 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.894 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.895 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.896 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.897 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.898 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.899 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.900 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.901 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.902 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.903 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_host": { 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_host", 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.904 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_port": { 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_port", 2024-09-21T07:20:51.905 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10051", 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_sender": { 2024-09-21T07:20:51.906 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_sender", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.907 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: "gid": 24137, 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "y", 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_features": 4540719139924082687, 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: "available_modules": [ 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.908 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "alerts", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:20:51.909 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.910 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.911 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.912 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.913 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.914 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_destination": { 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_destination", 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.915 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_from_name": { 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_from_name", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.916 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "Ceph", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email From: name", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_host": { 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_host", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.917 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP server", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_password": { 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_password", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.918 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Password to authenticate with", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_port": { 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_port", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.919 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "465", 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP port", 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_sender": { 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_sender", 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.920 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_ssl": { 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_ssl", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.921 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_user": { 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_user", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "User to authenticate as", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.923 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "balancer", 2024-09-21T07:20:51.924 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "active": { 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "active", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:20:51.925 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_time": { 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_time", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0000", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:20:51.926 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_weekday": { 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_weekday", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:20:51.927 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_max_iterations": { 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "25", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "250", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.928 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_metrics": { 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_metrics", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.929 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_step": { 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_step", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.5", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0.001", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "0.999", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "end_time": { 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_time", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2359", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.931 INFO:teuthology.orchestra.run.smithi029.stdout: "end_weekday": { 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_weekday", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.932 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.933 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.934 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.935 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.936 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.937 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "min_score": { 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_score", 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:20:51.938 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "upmap", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-compat", 2024-09-21T07:20:51.939 INFO:teuthology.orchestra.run.smithi029.stdout: "none", 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "read", 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap", 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap-read" 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Balancer mode", 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_ids": { 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_ids", 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.940 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.941 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:51.942 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_deviation": { 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_deviation", 2024-09-21T07:20:51.943 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_optimizations": { 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:51.944 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.945 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_down_multiplier": { 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_down_multiplier", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.946 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_refresh_rate": { 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_refresh_rate", 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "20", 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.947 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_starting_port": { 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_starting_port", 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4721", 2024-09-21T07:20:51.948 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_ptrace": { 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_ptrace", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.949 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_interval": { 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_interval", 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.950 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.951 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.7", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_log_destination": { 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm_log_destination", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.952 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "file", 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "file,syslog", 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "syslog" 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.953 INFO:teuthology.orchestra.run.smithi029.stdout: "cgroups_split": { 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cgroups_split", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.954 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "config_checks_enabled": { 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_checks_enabled", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.955 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "config_dashboard": { 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_dashboard", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.956 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_alertmanager": { 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_alertmanager", 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.957 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_base": { 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_base", 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.958 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_elasticsearch": { 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.959 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "elasticsearch container image", 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_grafana": { 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_grafana", 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.960 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_haproxy": { 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_haproxy", 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.961 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "HAproxy container image", 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_agent": { 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.962 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_collector": { 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:20:51.963 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.964 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_query": { 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger query container image", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.965 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_keepalived": { 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_keepalived", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Keepalived container image", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.966 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_loki": { 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_loki", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Loki container image", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.967 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nginx": { 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nginx", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nginx container image", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.968 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_node_exporter": { 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_node_exporter", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.969 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nvmeof": { 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nvmeof", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nvme-of container image", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.970 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.971 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_prometheus": { 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_prometheus", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.972 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_promtail": { 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_promtail", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Promtail container image", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba": { 2024-09-21T07:20:51.973 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba_metrics": { 2024-09-21T07:20:51.974 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_snmp_gateway": { 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:20:51.975 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "container_init": { 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_init", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.976 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "daemon_cache_timeout": { 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.977 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:20:51.978 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "900", 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "default_registry": { 2024-09-21T07:20:51.979 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_registry", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "device_cache_timeout": { 2024-09-21T07:20:51.980 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_cache_timeout", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1800", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.981 INFO:teuthology.orchestra.run.smithi029.stdout: "device_enhanced_scan": { 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_enhanced_scan", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.982 INFO:teuthology.orchestra.run.smithi029.stdout: "facts_cache_timeout": { 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "facts_cache_timeout", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "grafana_dashboards_path": { 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:20:51.983 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "host_check_interval": { 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "host_check_interval", 2024-09-21T07:20:51.984 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "hw_monitoring": { 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hw_monitoring", 2024-09-21T07:20:51.985 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "inventory_list_all": { 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "inventory_list_all", 2024-09-21T07:20:51.986 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:51.987 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.988 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "log_refresh_metadata": { 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_refresh_metadata", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:20:51.989 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:20:51.990 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.991 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:51.992 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:20:51.993 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:20:51.994 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "*", 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "max_count_per_host": { 2024-09-21T07:20:51.995 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_count_per_host", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd_draining_count": { 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_osd_draining_count", 2024-09-21T07:20:51.996 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.997 INFO:teuthology.orchestra.run.smithi029.stdout: "migration_current": { 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "migration_current", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "internal - do not modify", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-21T07:20:51.998 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "root", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm-package", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "root" 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:51.999 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "oob_default_addr": { 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "oob_default_addr", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "169.254.1.1", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.000 INFO:teuthology.orchestra.run.smithi029.stdout: "prometheus_alerts_path": { 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_insecure": { 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_insecure", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.002 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_password": { 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_password", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.003 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_url": { 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_url", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.004 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_username": { 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_username", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.005 INFO:teuthology.orchestra.run.smithi029.stdout: "secure_monitoring_stack": { 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.006 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "service_discovery_port": { 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "service_discovery_port", 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8765", 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:20:52.007 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.008 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_config_file": { 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_config_file", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.009 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-21T07:20:52.010 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_keepalive_interval": { 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.011 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "use_agent": { 2024-09-21T07:20:52.012 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_agent", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.013 INFO:teuthology.orchestra.run.smithi029.stdout: "use_repo_digest": { 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_repo_digest", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.014 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_failed_host_check": { 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.015 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_daemons": { 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.016 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_hosts": { 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.017 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crash", 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.018 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.019 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.020 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.021 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.022 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "retain_interval": { 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retain_interval", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "31536000", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.023 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.024 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_recent_interval": { 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_recent_interval", 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.025 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1209600", 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dashboard", 2024-09-21T07:20:52.026 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.027 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.028 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.029 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.030 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.031 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.032 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.033 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:20:52.034 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:20:52.035 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.036 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.037 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.038 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.040 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.041 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.042 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.043 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_URL": { 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.044 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.045 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.046 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.047 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.048 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.049 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "[]", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.050 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "{}", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.051 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.052 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.053 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:20:52.055 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:20:52.056 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:20:52.057 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.058 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:20:52.060 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:20:52.061 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.062 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.064 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "45", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.065 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.067 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.068 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.069 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.070 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.071 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.072 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.073 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "cross_origin_url": { 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cross_origin_url", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.074 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "crt_file": { 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crt_file", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.075 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "debug": { 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "debug", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.076 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "jwt_token_ttl": { 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "jwt_token_ttl", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.077 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "28800", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.078 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.079 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.080 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.081 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.082 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.083 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "motd": { 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "motd", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.084 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "The message of the day", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.085 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.086 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8080", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.087 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.088 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.089 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl_server_port": { 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl_server_port", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8443", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.090 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "sso_oauth2": { 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sso_oauth2", 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.091 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.092 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "redirect", 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect" 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.093 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.094 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "url_prefix": { 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url_prefix", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.095 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_monitoring": { 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_monitoring", 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.096 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "monitor device health metrics", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.097 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.098 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.099 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.100 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.101 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.102 INFO:teuthology.orchestra.run.smithi029.stdout: "mark_out_threshold": { 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mark_out_threshold", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2419200", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.103 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": { 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_name", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "device_health_metrics", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.104 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "retention_period": { 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retention_period", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15552000", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.105 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_frequency": { 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_frequency", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.106 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "self_heal": { 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "self_heal", 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:20:52.107 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.108 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.109 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_threshold": { 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_threshold", 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7257600", 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.110 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "diskprediction_local", 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.111 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.112 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.112 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.112 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.112 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.112 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.113 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.114 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.115 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.116 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.117 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "predict_interval": { 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predict_interval", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.118 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "predictor_model": { 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predictor_model", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "prophetstor", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.119 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.120 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.121 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "influx", 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": false, 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "batch_size": { 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "batch_size", 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.122 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5000", 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "database": { 2024-09-21T07:20:52.123 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "database", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "ceph", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.124 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": { 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hostname", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.125 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "30", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "5", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.126 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.127 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.128 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.129 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.130 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.131 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "password": { 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "password", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.132 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "port": { 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "port", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8086", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.133 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server port", 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.134 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "false", 2024-09-21T07:20:52.135 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "threads": { 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threads", 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.136 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "32", 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "username": { 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "username", 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.137 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "verify_ssl": { 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "verify_ssl", 2024-09-21T07:20:52.138 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "true", 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.139 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "insights", 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.140 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.141 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.142 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.143 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.144 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.145 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.146 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "iostat", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.147 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.148 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.149 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.150 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.151 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.152 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "k8sevents", 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.153 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_event_retention_days": { 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.154 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "config_check_secs": { 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_check_secs", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "10", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.155 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.156 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.157 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.158 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.159 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.160 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.161 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.162 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "localpool", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "failure_domain": { 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "failure_domain", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "host", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.163 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.164 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.165 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.166 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.167 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.168 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": { 2024-09-21T07:20:52.169 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_size", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.170 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "num_rep": { 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "num_rep", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.171 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": { 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_num", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "128", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.172 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "prefix": { 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prefix", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.173 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.174 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "subtree": { 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "subtree", 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "rack", 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:20:52.175 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mds_autoscaler", 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.176 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.177 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.178 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.179 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.180 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.181 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.182 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirroring", 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.183 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.184 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.185 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.186 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.187 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.188 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.189 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "nfs", 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.190 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.191 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.192 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.193 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.194 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.195 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.196 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "fail_fs": { 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "fail_fs", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.197 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.198 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.199 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.200 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.201 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.202 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator": { 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.203 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "rook", 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "test_orchestrator" 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Orchestrator backend", 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.204 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.205 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_perf_query", 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.206 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.207 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.208 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.209 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.210 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.211 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_support", 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.212 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.213 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.214 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.215 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.216 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.217 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.218 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_autoscaler", 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.219 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.220 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.221 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.222 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.223 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.224 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.225 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "threshold": { 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threshold", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1.0", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.226 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "scaling threshold", 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "progress", 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_pg_recovery_event": { 2024-09-21T07:20:52.227 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-21T07:20:52.228 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.229 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.230 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.231 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.232 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.233 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.234 INFO:teuthology.orchestra.run.smithi029.stdout: "max_completed_events": { 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_completed_events", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "50", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.235 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.236 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.237 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus", 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "cache": { 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cache", 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.238 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "exclude_perf_counters": { 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "exclude_perf_counters", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.239 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.240 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.241 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.242 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.243 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.244 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools": { 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.245 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.246 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "300", 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_interval": { 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_interval", 2024-09-21T07:20:52.247 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15.0", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.248 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:52.249 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "9283", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.250 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "stale_cache_strategy": { 2024-09-21T07:20:52.251 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stale_cache_strategy", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "log", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-21T07:20:52.252 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "default", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "default", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "error" 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.253 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.254 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.255 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.256 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.257 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.258 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_snap_create": { 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.260 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.261 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.262 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "trash_purge_schedule": { 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "trash_purge_schedule", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.263 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "restful", 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_auth": { 2024-09-21T07:20:52.264 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_auth", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-21T07:20:52.265 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.266 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.267 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.268 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.269 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.270 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.271 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "max_requests": { 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_requests", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.272 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.273 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.274 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.275 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rgw", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.276 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.277 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.278 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.279 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.280 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.281 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.282 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rook", 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.283 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.284 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.285 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.286 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.287 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.288 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.289 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_class": { 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "storage_class", 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "local", 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.290 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "selftest", 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.291 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.292 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.293 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.294 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.295 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "roption1": { 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption1", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.297 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "roption2": { 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption2", 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "xyz", 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.298 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption1": { 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption1", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.299 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption2": { 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption2", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.300 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption3": { 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption3", 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption4": { 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption4", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.302 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption5": { 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption5", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.303 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption6": { 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption6", 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.304 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption7": { 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption7", 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.305 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "42", 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.306 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "testkey": { 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testkey", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.307 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "testlkey": { 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testlkey", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.308 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "testnewline": { 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testnewline", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.309 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smb", 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.310 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "internal_store_backend": { 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "internal_store_backend", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.311 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.312 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.313 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.314 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.315 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.316 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.317 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "update_orchestration": { 2024-09-21T07:20:52.318 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "update_orchestration", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.319 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snap_schedule", 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_m_granularity": { 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_m_granularity", 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.320 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "dump_on_update": { 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dump_on_update", 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.321 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.322 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.323 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.324 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.325 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.326 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.327 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.328 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stats", 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.329 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.330 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.331 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.332 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.333 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.334 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.335 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "status", 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.336 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.337 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.338 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.339 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.340 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.341 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.342 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telegraf", 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "address": { 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "address", 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.343 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.344 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.345 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.346 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.347 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.348 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.349 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.350 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.351 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telemetry", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_basic": { 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_basic", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:20:52.352 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_crash": { 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_crash", 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.353 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_device": { 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_device", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.354 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_ident": { 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_ident", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.355 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_perf": { 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_perf", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.356 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "contact": { 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "contact", 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.357 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "description": { 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "description", 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.358 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "device_url": { 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_url", 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.359 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.360 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.361 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "24", 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "8", 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "last_opt_revision": { 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "last_opt_revision", 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.362 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1", 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard": { 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard", 2024-09-21T07:20:52.363 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard_description": { 2024-09-21T07:20:52.364 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard_description", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.365 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.366 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.367 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.368 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.369 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.370 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "organization": { 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "organization", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.371 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "proxy": { 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "proxy", 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.372 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.373 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "url": { 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url", 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.374 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "test_orchestrator", 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.375 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.376 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.377 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.378 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.379 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.380 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.381 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.382 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.383 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.384 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.385 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.386 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_clones": { 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_clones", 2024-09-21T07:20:52.387 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4", 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "periodic_async_work": { 2024-09-21T07:20:52.388 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "periodic_async_work", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Periodically check for async work", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.389 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_delay": { 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.390 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.391 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.392 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix", 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "discovery_interval": { 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "discovery_interval", 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:52.393 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "100", 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "identifier": { 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "identifier", 2024-09-21T07:20:52.394 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.395 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.396 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.397 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.398 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.399 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.400 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.401 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_host": { 2024-09-21T07:20:52.402 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_host", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_port": { 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_port", 2024-09-21T07:20:52.403 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10051", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_sender": { 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_sender", 2024-09-21T07:20:52.404 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.405 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "modules": [ 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "dashboard", 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "iostat", 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "nfs", 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "restful" 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "available_modules": [ 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "alerts", 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.406 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T07:20:52.407 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.408 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.409 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.410 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.411 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.412 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_destination": { 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_destination", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.413 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_from_name": { 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_from_name", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "Ceph", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email From: name", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.414 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_host": { 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_host", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP server", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.415 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_password": { 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_password", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Password to authenticate with", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_port": { 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_port", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "465", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP port", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.417 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_sender": { 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_sender", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP envelope sender", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.418 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_ssl": { 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_ssl", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.419 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_user": { 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_user", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "User to authenticate as", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.420 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.421 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "balancer", 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "active": { 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "active", 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.422 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_time": { 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_time", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.423 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0000", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_weekday": { 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_weekday", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.424 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_max_iterations": { 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_max_iterations", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "25", 2024-09-21T07:20:52.425 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "250", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_metrics": { 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_metrics", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T07:20:52.426 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_step": { 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_step", 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.427 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.5", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0.001", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "0.999", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "aggressiveness of optimization", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "end_time": { 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_time", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2359", 2024-09-21T07:20:52.428 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "end_weekday": { 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_weekday", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-21T07:20:52.429 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.430 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.431 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.432 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.433 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.434 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "min_score": { 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_score", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.435 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.436 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "upmap", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-compat", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "none", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "read", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap-read" 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Balancer mode", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.437 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_ids": { 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_ids", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.438 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T07:20:52.439 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.440 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_deviation": { 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_deviation", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T07:20:52.441 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_optimizations": { 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_optimizations", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T07:20:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm", 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_down_multiplier": { 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_down_multiplier", 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.443 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_refresh_rate": { 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_refresh_rate", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.444 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "20", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_starting_port": { 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_starting_port", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.445 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4721", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_ptrace": { 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_ptrace", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.446 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_interval": { 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_interval", 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.447 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_memory_target_ratio": { 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.448 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.7", 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_log_destination": { 2024-09-21T07:20:52.449 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm_log_destination", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "file", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "file,syslog", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "syslog" 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T07:20:52.450 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "cgroups_split": { 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cgroups_split", 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.451 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "config_checks_enabled": { 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_checks_enabled", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T07:20:52.452 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "config_dashboard": { 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_dashboard", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T07:20:52.453 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_alertmanager": { 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_alertmanager", 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.454 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_base": { 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_base", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.455 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Container image name, without the tag", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_elasticsearch": { 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_elasticsearch", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.456 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "elasticsearch container image", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_grafana": { 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_grafana", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.457 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_haproxy": { 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_haproxy", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.458 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "HAproxy container image", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_agent": { 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_agent", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger agent container image", 2024-09-21T07:20:52.459 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_collector": { 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_collector", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger collector container image", 2024-09-21T07:20:52.460 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_query": { 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_query", 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.461 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger query container image", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_keepalived": { 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_keepalived", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Keepalived container image", 2024-09-21T07:20:52.462 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_loki": { 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_loki", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Loki container image", 2024-09-21T07:20:52.463 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nginx": { 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nginx", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nginx container image", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.464 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_node_exporter": { 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_node_exporter", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.465 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nvmeof": { 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nvmeof", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nvme-of container image", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.466 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_oauth2_proxy": { 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.467 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "oauth2-proxy container image", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_prometheus": { 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_prometheus", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.468 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_promtail": { 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_promtail", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.469 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Promtail container image", 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba": { 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba", 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T07:20:52.470 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB container image", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba_metrics": { 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba_metrics", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T07:20:52.471 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_snmp_gateway": { 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_snmp_gateway", 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.472 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SNMP Gateway container image", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "container_init": { 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_init", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.473 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "daemon_cache_timeout": { 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "daemon_cache_timeout", 2024-09-21T07:20:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "default_cephadm_command_timeout": { 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T07:20:52.475 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "900", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "default_registry": { 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_registry", 2024-09-21T07:20:52.476 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "device_cache_timeout": { 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_cache_timeout", 2024-09-21T07:20:52.477 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1800", 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache device inventory", 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "device_enhanced_scan": { 2024-09-21T07:20:52.478 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_enhanced_scan", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "facts_cache_timeout": { 2024-09-21T07:20:52.479 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "facts_cache_timeout", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache host facts data", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "grafana_dashboards_path": { 2024-09-21T07:20:52.480 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "grafana_dashboards_path", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.481 INFO:teuthology.orchestra.run.smithi029.stdout: "host_check_interval": { 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "host_check_interval", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to perform a host check", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.482 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "hw_monitoring": { 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hw_monitoring", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.483 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "inventory_list_all": { 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "inventory_list_all", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.484 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.485 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "log_refresh_metadata": { 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_refresh_metadata", 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.486 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.487 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.488 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.489 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.490 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.491 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "*", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T07:20:52.492 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "max_count_per_host": { 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_count_per_host", 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.493 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of daemons per service per host", 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd_draining_count": { 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_osd_draining_count", 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.494 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "migration_current": { 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "migration_current", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.495 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "internal - do not modify", 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "root", 2024-09-21T07:20:52.496 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm-package", 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "root" 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "oob_default_addr": { 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "oob_default_addr", 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.497 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "169.254.1.1", 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "prometheus_alerts_path": { 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus_alerts_path", 2024-09-21T07:20:52.498 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_insecure": { 2024-09-21T07:20:52.499 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_insecure", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.500 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_password": { 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_password", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.501 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_url": { 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_url", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.502 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_username": { 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_username", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.503 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "secure_monitoring_stack": { 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secure_monitoring_stack", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.504 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "service_discovery_port": { 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "service_discovery_port", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8765", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "cephadm service discovery port", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.506 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_config_file": { 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_config_file", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.507 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_keepalive_count_max": { 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T07:20:52.508 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_keepalive_interval": { 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_keepalive_interval", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T07:20:52.509 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "use_agent": { 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_agent", 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.510 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "use_repo_digest": { 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_repo_digest", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.511 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_failed_host_check": { 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_failed_host_check", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.512 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_daemons": { 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_daemons", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T07:20:52.513 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_hosts": { 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_hosts", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T07:20:52.514 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crash", 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.515 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.516 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.517 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.518 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.519 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "retain_interval": { 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retain_interval", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.520 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "31536000", 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.521 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_recent_interval": { 2024-09-21T07:20:52.522 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_recent_interval", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1209600", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.523 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dashboard", 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.524 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.525 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.526 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_ENABLED": { 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.527 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.528 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.529 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T07:20:52.530 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T07:20:52.531 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T07:20:52.532 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.534 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.536 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.537 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.538 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.539 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.540 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_URL": { 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_URL", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T07:20:52.541 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.542 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.543 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.544 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.545 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.546 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "[]", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.547 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "{}", 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.548 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.549 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.550 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.551 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.552 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.553 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.554 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.555 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.556 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.557 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.558 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.559 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.560 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.561 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.562 INFO:teuthology.orchestra.run.smithi029.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "45", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.564 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.565 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.566 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.567 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.569 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.570 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.571 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "cross_origin_url": { 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cross_origin_url", 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.572 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "crt_file": { 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crt_file", 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.573 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "debug": { 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "debug", 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.574 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable/disable debug options", 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "jwt_token_ttl": { 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "jwt_token_ttl", 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.575 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "28800", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.576 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.577 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.578 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.579 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.580 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.581 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.582 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "motd": { 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "motd", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "The message of the day", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.583 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect_resolve_ip_addr": { 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.584 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.585 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8080", 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.586 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.587 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.588 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl_server_port": { 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl_server_port", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8443", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.589 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "sso_oauth2": { 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sso_oauth2", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.590 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "redirect", 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect" 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.591 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-21T07:20:52.592 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "url_prefix": { 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url_prefix", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.593 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_monitoring": { 2024-09-21T07:20:52.594 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_monitoring", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "monitor device health metrics", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.595 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.596 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.597 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.598 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.599 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.600 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "mark_out_threshold": { 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mark_out_threshold", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2419200", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.601 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": { 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_name", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "device_health_metrics", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.602 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "retention_period": { 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retention_period", 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15552000", 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain device health metrics", 2024-09-21T07:20:52.603 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_frequency": { 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_frequency", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T07:20:52.604 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "self_heal": { 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "self_heal", 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.605 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.606 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_threshold": { 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_threshold", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.608 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7257600", 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "diskprediction_local", 2024-09-21T07:20:52.609 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.610 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.611 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.612 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.613 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.614 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "predict_interval": { 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predict_interval", 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.615 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "predictor_model": { 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predictor_model", 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "prophetstor", 2024-09-21T07:20:52.616 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-21T07:20:52.617 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.618 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "influx", 2024-09-21T07:20:52.619 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": false, 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "influxdb python module not found", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "batch_size": { 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "batch_size", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5000", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.620 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "database": { 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "database", 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "ceph", 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T07:20:52.621 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": { 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hostname", 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.622 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server hostname", 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "30", 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "5", 2024-09-21T07:20:52.623 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.624 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.625 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.626 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.627 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.628 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "password": { 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "password", 2024-09-21T07:20:52.629 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "password of InfluxDB server user", 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: "port": { 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "port", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8086", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server port", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.631 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.632 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "false", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.633 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "threads": { 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threads", 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "32", 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.634 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "username": { 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "username", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.635 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "username of InfluxDB server user", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "verify_ssl": { 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "verify_ssl", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "true", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.636 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "insights", 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.637 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.638 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.639 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.640 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.641 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.642 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "iostat", 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.644 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.645 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.646 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.647 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.648 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.649 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.650 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "k8sevents", 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_event_retention_days": { 2024-09-21T07:20:52.651 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ceph_event_retention_days", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "config_check_secs": { 2024-09-21T07:20:52.652 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_check_secs", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "10", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.653 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.654 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.655 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.656 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.657 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.658 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "localpool", 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "failure_domain": { 2024-09-21T07:20:52.660 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "failure_domain", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "host", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "failure domain for any created local pool", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.661 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.662 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.663 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.664 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.665 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.666 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": { 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_size", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default min_size for any created local pool", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T07:20:52.667 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "num_rep": { 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "num_rep", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default replica count for any created local pool", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.668 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": { 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_num", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "128", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.669 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "prefix": { 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prefix", 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name prefix for any created local pool", 2024-09-21T07:20:52.670 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.671 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "subtree": { 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "subtree", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "rack", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.672 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mds_autoscaler", 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.673 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.674 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.675 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.676 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.677 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.679 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirroring", 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.680 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.681 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.682 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.683 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.684 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.685 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.686 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "nfs", 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.687 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.688 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.689 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.690 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.692 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.693 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "fail_fs": { 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "fail_fs", 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.694 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.695 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.696 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.697 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.698 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.699 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator": { 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.700 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "rook", 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "test_orchestrator" 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Orchestrator backend", 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.701 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.702 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_perf_query", 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.703 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.704 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.705 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.706 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.707 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.708 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_support", 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.709 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.710 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.711 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.713 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.714 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.715 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_autoscaler", 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.716 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.717 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.718 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.719 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.720 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.721 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.722 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "threshold": { 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threshold", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.723 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.724 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-21T07:20:52.724 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1.0", 2024-09-21T07:20:52.724 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.725 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.725 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "scaling threshold", 2024-09-21T07:20:52.725 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T07:20:52.725 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.725 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.725 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.725 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "progress", 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_pg_recovery_event": { 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_pg_recovery_event", 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.726 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.727 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.728 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.730 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.731 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.732 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "max_completed_events": { 2024-09-21T07:20:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_completed_events", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "50", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "number of past completed events to remember", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-21T07:20:52.734 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long the module is going to sleep", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.735 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.736 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "cache": { 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cache", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.737 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "exclude_perf_counters": { 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "exclude_perf_counters", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.738 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.739 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.740 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.741 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.742 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.743 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools": { 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.744 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "300", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_interval": { 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_interval", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15.0", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.746 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.747 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "9283", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.748 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.749 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "stale_cache_strategy": { 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stale_cache_strategy", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "log", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.750 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "default", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.751 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "default", 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "error" 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.752 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.753 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.754 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.755 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.756 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.757 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.758 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_snap_create": { 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_snap_create", 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "mirror_snapshot_schedule": { 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.760 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.761 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "trash_purge_schedule": { 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "trash_purge_schedule", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.762 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "restful", 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_auth": { 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_auth", 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.763 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.764 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.765 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.766 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.767 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.768 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.769 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "max_requests": { 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_requests", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.770 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.771 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.773 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.774 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rgw", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.775 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.776 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.777 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.778 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.779 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T07:20:52.780 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.781 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.782 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rook", 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.783 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.784 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.785 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.786 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.787 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.788 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_class": { 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "storage_class", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "local", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.789 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "selftest", 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.790 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.791 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.792 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.793 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.794 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "roption1": { 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption1", 2024-09-21T07:20:52.795 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "roption2": { 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption2", 2024-09-21T07:20:52.796 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "xyz", 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption1": { 2024-09-21T07:20:52.797 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption1", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption2": { 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption2", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.799 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption3": { 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption3", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.800 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption4": { 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption4", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption5": { 2024-09-21T07:20:52.801 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption5", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption6": { 2024-09-21T07:20:52.802 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption6", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.803 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption7": { 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption7", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "42", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.804 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.805 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "testkey": { 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testkey", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.806 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "testlkey": { 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testlkey", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.807 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "testnewline": { 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testnewline", 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.808 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smb", 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "internal_store_backend": { 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "internal_store_backend", 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.809 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.810 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.811 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.812 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.813 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.814 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.815 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.816 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "update_orchestration": { 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "update_orchestration", 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T07:20:52.817 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snap_schedule", 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_m_granularity": { 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_m_granularity", 2024-09-21T07:20:52.818 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "dump_on_update": { 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dump_on_update", 2024-09-21T07:20:52.819 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "dump database to debug log on update", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.820 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.821 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.822 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.823 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.824 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.825 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.826 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stats", 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.827 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.828 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.829 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.830 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.831 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.832 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "status", 2024-09-21T07:20:52.833 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.835 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.836 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.837 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.839 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telegraf", 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "address": { 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "address", 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T07:20:52.840 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15", 2024-09-21T07:20:52.841 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.842 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.843 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.844 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.845 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.846 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.847 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.848 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telemetry", 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_basic": { 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_basic", 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.849 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_crash": { 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_crash", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.850 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_device": { 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_device", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.851 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_ident": { 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_ident", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.852 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_perf": { 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_perf", 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.853 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "contact": { 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "contact", 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.854 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "description": { 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "description", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.855 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "device_url": { 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_url", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.856 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.857 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.858 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "24", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "8", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "last_opt_revision": { 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "last_opt_revision", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.859 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard": { 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.860 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard_description": { 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard_description", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.861 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.862 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.863 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.865 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.866 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "organization": { 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "organization", 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.867 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "proxy": { 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "proxy", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.868 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.869 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "url": { 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.870 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "test_orchestrator", 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.871 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.872 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.873 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.874 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.875 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.876 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-21T07:20:52.877 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.878 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.879 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.880 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.881 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.882 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_clones": { 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_clones", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.883 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "periodic_async_work": { 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "periodic_async_work", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.884 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Periodically check for async work", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_delay": { 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_delay", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.885 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_no_wait": { 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-21T07:20:52.886 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.887 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix", 2024-09-21T07:20:52.888 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "discovery_interval": { 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "discovery_interval", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "100", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.889 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "identifier": { 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "identifier", 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.890 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.891 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.892 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-21T07:20:52.893 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.894 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-21T07:20:52.895 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-21T07:20:52.896 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "sqlite3_killpoint": { 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sqlite3_killpoint", 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "dev", 2024-09-21T07:20:52.897 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_host": { 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_host", 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.898 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_port": { 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_port", 2024-09-21T07:20:52.899 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10051", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_sender": { 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_sender", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-21T07:20:52.900 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "services": { 2024-09-21T07:20:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: "dashboard": "https://172.21.15.29:8443/" 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "always_on_modules": { 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "octopus": [ 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-21T07:20:52.902 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "pacific": [ 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-21T07:20:52.903 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "quincy": [ 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-21T07:20:52.904 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "reef": [ 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-21T07:20:52.905 INFO:teuthology.orchestra.run.smithi029.stdout: "squid": [ 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "last_failure_osd_epoch": 3, 2024-09-21T07:20:52.906 INFO:teuthology.orchestra.run.smithi029.stdout: "active_clients": [ 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 506368439 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "libcephsqlite", 2024-09-21T07:20:52.907 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 923900830 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-21T07:20:52.908 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3588213703 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2475348155 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:52.909 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:52.910 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-21T07:20:52.910 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:20:52.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a7c0b6510 msgr2=0x7f6a7c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:52.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a7c0b6510 0x7f6a7c0b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000c00 tx=0x7f6a80031400 comp rx=0 tx=0).stop 2024-09-21T07:20:52.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90109560 msgr2=0x7f6a9019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:20:52.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90109560 0x7f6a9019b180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009fd0 tx=0x7f6a8800b260 comp rx=0 tx=0).stop 2024-09-21T07:20:52.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 shutdown_connections 2024-09-21T07:20:52.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f6a7c0b6510 0x7f6a7c0b8a20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:52.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a90109560 0x7f6a9019b180 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:52.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a90106c00 0x7f6a9019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:52.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 --2- 172.21.15.29:0/3275316440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a90101ab0 0x7f6a90199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:20:52.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 >> 172.21.15.29:0/3275316440 conn(0x7f6a900fd690 msgr2=0x7f6a90107a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:20:52.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 shutdown_connections 2024-09-21T07:20:52.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:20:51.329+0000 7f6a95ece640 1 -- 172.21.15.29:0/3275316440 wait complete. 2024-09-21T07:20:52.959 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T07:20:52.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T07:20:52.959 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:51 smithi029 ceph-mon[30983]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 201 MiB/s wr, 523 op/s 2024-09-21T07:20:52.959 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:51 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3828653802' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:20:52.959 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:51 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/1821975999' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:20:52.960 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:51 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3275316440' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:20:52.960 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:51 smithi052 ceph-mon[34308]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 201 MiB/s wr, 523 op/s 2024-09-21T07:20:52.960 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:51 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3828653802' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:20:52.960 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:51 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/1821975999' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:20:52.961 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:51 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3275316440' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:20:52.961 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:51 smithi066 ceph-mon[34793]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 201 MiB/s wr, 523 op/s 2024-09-21T07:20:52.961 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:51 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3828653802' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T07:20:52.961 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:51 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/1821975999' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T07:20:52.961 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:51 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3275316440' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T07:20:53.233 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:53.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:53 smithi029 ceph-mon[30983]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 192 MiB/s wr, 608 op/s 2024-09-21T07:20:53.833 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:20:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:20:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 1021, 2024-09-21T07:20:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 1013, 2024-09-21T07:20:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 843600, 2024-09-21T07:20:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 386072, 2024-09-21T07:20:53.833 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 5, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 1, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.167606542, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.072908762, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.055120518, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.034693849, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 1012, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.095065842, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000093938 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:53.834 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 578832, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 135488 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 724, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 887, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 180630, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 608598, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 5, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 4, 2024-09-21T07:20:53.835 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.115446777, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.044930649, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.022031192, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.033495163, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 886, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.074791575, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000084414 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 379888 2024-09-21T07:20:53.836 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 794, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 796, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 209417, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 252493, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 4, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 3, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.100030021, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.039384657, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.021908054, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.025701822, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 794, 2024-09-21T07:20:53.837 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.072811934, 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000091702 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "cct": { 2024-09-21T07:20:53.838 INFO:teuthology.orchestra.run.smithi029.stdout: "total_workers": 1, 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "unhealthy_workers": 0 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "finisher-MDSRank": { 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "queue_len": 0, 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "complete_latency": { 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 3762, 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.153385383, 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000040772 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "finisher-PurgeQueue": { 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "queue_len": 0, 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "complete_latency": { 2024-09-21T07:20:53.839 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "request": 0, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "reply": 0, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "reply_latency": { 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "slow_reply": 0, 2024-09-21T07:20:53.840 INFO:teuthology.orchestra.run.smithi029.stdout: "forward": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_fetch_complete": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_fetch_keys": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_commit": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_split": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_merge": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_top": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_bottom": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_pin_tail": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_pinned": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_expired": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_with_caps": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": 0, 2024-09-21T07:20:53.841 INFO:teuthology.orchestra.run.smithi029.stdout: "subtrees": 1, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_hit": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_forward": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_discover": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_remote_ino": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_lock": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "load_cent": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "q": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "exported": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "exported_inodes": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "imported": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "imported_inodes": 0, 2024-09-21T07:20:53.842 INFO:teuthology.orchestra.run.smithi029.stdout: "openino_dir_fetch": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "openino_peer_discover": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "root_rfiles": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "root_rbytes": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "root_rsnaps": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_set_tag": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_file_inodes": 0, 2024-09-21T07:20:53.843 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_caps": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_cap_release": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "process_request_cap_release": 0 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache": { 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_update": 0, 2024-09-21T07:20:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_update_receipt": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_try_discover": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_send_discover": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_handle_discover": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "num_strays": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "num_strays_delayed": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_created": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_enqueued": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_reintegrated": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_migrated": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "num_recovering_processing": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_started": 0, 2024-09-21T07:20:53.845 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_completed": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_exportdir": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_flush": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_fragstats": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_inodestats": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "uninline_started": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "uninline_succeeded": 0, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "uninline_write_failed": 0 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log": { 2024-09-21T07:20:53.846 INFO:teuthology.orchestra.run.smithi029.stdout: "evlrg": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "evadd": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "evex": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "evtrm": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "ev": 5, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "evexg": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "evexd": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "segadd": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "segex": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "segtrm": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "seg": 2, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "segmjr": 2, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "segexg": 0, 2024-09-21T07:20:53.847 INFO:teuthology.orchestra.run.smithi029.stdout: "segexd": 0, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "expos": 4194304, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "wrpos": 4195732, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "rdpos": 4195424, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "jlat": { 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "replayed": 5 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.848 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_mem": { 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "ino": 3, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "ino+": 3, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "ino-": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "dir": 1, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "dir+": 1, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "dir-": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "dn": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "dn+": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "dn-": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "cap": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "cap+": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "cap-": 0, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "rss": 117328, 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: "heap": 316420096 2024-09-21T07:20:53.849 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_server": { 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "dispatch_client_request": 0, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "dispatch_server_request": 0, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_request": 0, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_session": 0, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_peer_request": 0, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "req_create_latency": { 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "req_getattr_latency": { 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.850 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "req_getfilelock_latency": { 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "req_link_latency": { 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookup_latency": { 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.851 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookuphash_latency": { 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupino_latency": { 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupname_latency": { 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.852 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupparent_latency": { 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupsnap_latency": { 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lssnap_latency": { 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.853 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.854 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:53 smithi066 ceph-mon[34793]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 192 MiB/s wr, 608 op/s 2024-09-21T07:20:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "req_mkdir_latency": { 2024-09-21T07:20:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.854 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "req_mknod_latency": { 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "req_mksnap_latency": { 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "req_open_latency": { 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.855 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "req_readdir_latency": { 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rename_latency": { 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "req_renamesnap_latency": { 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.856 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "req_snapdiff_latency": { 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rmdir_latency": { 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rmsnap_latency": { 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.857 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rmxattr_latency": { 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setattr_latency": { 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setdirlayout_latency": { 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setfilelock_latency": { 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setlayout_latency": { 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.859 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setxattr_latency": { 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "req_symlink_latency": { 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "req_unlink_latency": { 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.860 INFO:teuthology.orchestra.run.smithi029.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "req_getvxattr_latency": { 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_sessions": { 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "session_count": 1, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "session_add": 2, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "session_remove": 1, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "sessions_open": 1, 2024-09-21T07:20:53.861 INFO:teuthology.orchestra.run.smithi029.stdout: "sessions_stale": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "total_load": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "average_load": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "avg_session_uptime": 1796, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "mdthresh_evicted": 0 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "mempool": { 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_items": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:20:53.862 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:20:53.863 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_items": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_items": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_bytes": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_items": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:20:53.864 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_bytes": 189383, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_items": 50, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_items": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bytes": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_items": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_items": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_items": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_bytes": 7496, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_items": 154, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:20:53.865 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_bytes": 0, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_items": 0, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_bytes": 8672, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_items": 13, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_bytes": 0, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_items": 0, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_bytes": 0, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_items": 0 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter": { 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "op_active": 0, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "op_laggy": 0, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "op_send": 2301, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "op_send_bytes": 21, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "op_resend": 3, 2024-09-21T07:20:53.866 INFO:teuthology.orchestra.run.smithi029.stdout: "op_reply": 2301, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "op_latency": { 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 2301, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 2.127965498, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000924800 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "op_inflight": 0, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "oplen_avg": { 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 2301, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 2302 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "op": 2301, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "op_r": 2301, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "op_w": 0, 2024-09-21T07:20:53.867 INFO:teuthology.orchestra.run.smithi029.stdout: "op_rmw": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "op_pg": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_stat": 1504, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_create": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_read": 795, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_write": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_writefull": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_writesame": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_append": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_zero": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_truncate": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_delete": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_mapext": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_sparse_read": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_clonerange": 0, 2024-09-21T07:20:53.868 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_getxattr": 1, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_setxattr": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_rmxattr": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_call": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_watch": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_notify": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_pgls": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_other": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_active": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_send": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_resend": 0, 2024-09-21T07:20:53.869 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_ping": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "poolop_active": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "poolop_send": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "poolop_resend": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "poolstat_active": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "poolstat_send": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "poolstat_resend": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "statfs_active": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "statfs_send": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "statfs_resend": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "command_active": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "command_send": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "command_resend": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "map_epoch": 75, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "map_full": 0, 2024-09-21T07:20:53.870 INFO:teuthology.orchestra.run.smithi029.stdout: "map_inc": 2, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_sessions": 5, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_session_open": 5, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_session_close": 0, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_laggy": 0, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_wr": 0, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_rd": 2, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_del": 0 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "oft": { 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_objs": 0, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_updates": 0, 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_removes": 0 2024-09-21T07:20:53.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "purge_queue": { 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing_ops": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing_high_water": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executed_ops": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executed": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_item_in_journal": 0 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 104857600, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 2535, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 990600, 2024-09-21T07:20:53.872 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 2535, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 2535, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 990600, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-objecter_bytes": { 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 104857600, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:53.873 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 2301, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 1433, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 2301, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 1433, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.874 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-objecter_ops": { 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 1024, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 2301, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 2301, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 2301, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 2301, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.875 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 3758096384, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 0, 2024-09-21T07:20:53.876 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 0, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-write_buf_throttle-0x563ebef096c0": { 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 3758096384, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 0, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 0, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "trackedop": { 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: "slow_ops_count": 0 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:53.878 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:20:53.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:53 smithi052 ceph-mon[34308]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 192 MiB/s wr, 608 op/s 2024-09-21T07:20:55.112 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T07:20:55.112 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T07:20:55.113 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T07:20:55.113 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T07:20:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:55 smithi066 ceph-mon[34793]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 158 MiB/s wr, 632 op/s 2024-09-21T07:20:55.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:55 smithi066 ceph-mon[34793]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:20:55.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:55 smithi029 ceph-mon[30983]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 158 MiB/s wr, 632 op/s 2024-09-21T07:20:55.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:55 smithi029 ceph-mon[30983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:20:55.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:55 smithi052 ceph-mon[34308]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 158 MiB/s wr, 632 op/s 2024-09-21T07:20:55.994 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:55 smithi052 ceph-mon[34308]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 0, 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 2, 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 0, 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 4, 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 0, 2024-09-21T07:20:56.060 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.001477729, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.000282466, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:56.061 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 231, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 226, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 533344, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 138112, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 2, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 1, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.042822424, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.020200061, 2024-09-21T07:20:56.062 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.027582589, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 226, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.019963361, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000088333 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 533344, 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 138112 2024-09-21T07:20:56.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 1, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 170, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 110112, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 3, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 2, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.019265103, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.015243288, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.001420719, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:56.064 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 168, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.009638662, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000057372 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 110112 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "cct": { 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "total_workers": 0, 2024-09-21T07:20:56.065 INFO:teuthology.orchestra.run.smithi029.stdout: "unhealthy_workers": 0 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "mempool": { 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_items": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:20:56.066 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_items": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_items": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:20:56.067 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_items": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_items": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_bytes": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_items": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_bytes": 149001, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_items": 31, 2024-09-21T07:20:56.068 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_items": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bytes": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_items": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_items": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_items": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_bytes": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_items": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_bytes": 0, 2024-09-21T07:20:56.069 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_items": 0, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_bytes": 968, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_items": 2, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_bytes": 0, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_items": 0, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_bytes": 0, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_items": 0 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 104857600, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 228, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 498326, 2024-09-21T07:20:56.070 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 228, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 228, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 498326, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:56.071 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:20:56.835 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T07:20:56.835 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T07:20:56.835 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T07:20:56.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T07:20:57.095 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:57.841 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:57 smithi029 ceph-mon[30983]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 124 MiB/s wr, 678 op/s 2024-09-21T07:20:57.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:57 smithi066 ceph-mon[34793]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 124 MiB/s wr, 678 op/s 2024-09-21T07:20:57.857 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 1028, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 1019, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 852224, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 388624, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 5, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 1, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.167857721, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.077559675, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.057793999, 2024-09-21T07:20:57.858 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.030228300, 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 1018, 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.066393355, 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000065219 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.859 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 586112, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 136768 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 1522, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 1686, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 390450, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 862527, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 5, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 4, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.167101264, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.069526199, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.035658923, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.051483898, 2024-09-21T07:20:57.860 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 1685, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.142148228, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000084360 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 380064 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.861 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 4, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 6, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 1629, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 1284, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 5, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 4, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.001541657, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.000105172, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.001227256, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.000081385, 2024-09-21T07:20:57.862 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 4, 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.002392451, 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000598112 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:20:57.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "cct": { 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "total_workers": 1, 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "unhealthy_workers": 0 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "finisher-MDSRank": { 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "queue_len": 0, 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "complete_latency": { 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 3823, 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.124779310, 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000032639 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.864 INFO:teuthology.orchestra.run.smithi029.stdout: "finisher-PurgeQueue": { 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "queue_len": 0, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "complete_latency": { 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "mds": { 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "request": 0, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "reply": 0, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "reply_latency": { 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.865 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "slow_reply": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "forward": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_fetch_complete": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_fetch_keys": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_commit": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_split": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_merge": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_top": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_bottom": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_pin_tail": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_pinned": 0, 2024-09-21T07:20:57.866 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_expired": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "inodes_with_caps": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "subtrees": 1, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_hit": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_forward": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_discover": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_remote_ino": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "traverse_lock": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "load_cent": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "q": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "exported": 0, 2024-09-21T07:20:57.867 INFO:teuthology.orchestra.run.smithi029.stdout: "exported_inodes": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "imported": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "imported_inodes": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "openino_dir_fetch": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "openino_peer_discover": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "root_rfiles": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "root_rbytes": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "root_rsnaps": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_set_tag": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:20:57.868 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "scrub_file_inodes": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_caps": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_cap_release": 0, 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: "process_request_cap_release": 0 2024-09-21T07:20:57.869 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache": { 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_update": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_update_receipt": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_try_discover": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_send_discover": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "dir_handle_discover": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "num_strays": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "num_strays_delayed": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_created": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_enqueued": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_reintegrated": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "strays_migrated": 0, 2024-09-21T07:20:57.870 INFO:teuthology.orchestra.run.smithi029.stdout: "num_recovering_processing": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_started": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_completed": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_exportdir": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_flush": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_fragstats": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "ireq_inodestats": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "uninline_started": 0, 2024-09-21T07:20:57.871 INFO:teuthology.orchestra.run.smithi029.stdout: "uninline_succeeded": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "uninline_write_failed": 0 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log": { 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "evlrg": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "evadd": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "evex": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "evtrm": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "ev": 5, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "evexg": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "evexd": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "segadd": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "segex": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "segtrm": 0, 2024-09-21T07:20:57.872 INFO:teuthology.orchestra.run.smithi029.stdout: "seg": 2, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "segmjr": 2, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "segexg": 0, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "segexd": 0, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "expos": 4194304, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "wrpos": 4195732, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "rdpos": 4195424, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "jlat": { 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "replayed": 5 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.873 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_mem": { 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "ino": 3, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "ino+": 3, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "ino-": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "dir": 1, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "dir+": 1, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "dir-": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "dn": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "dn+": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "dn-": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "cap": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "cap+": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "cap-": 0, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "rss": 117924, 2024-09-21T07:20:57.874 INFO:teuthology.orchestra.run.smithi029.stdout: "heap": 316428288 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_server": { 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "dispatch_client_request": 0, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "dispatch_server_request": 0, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_request": 0, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_client_session": 0, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "handle_peer_request": 0, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "req_create_latency": { 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.875 INFO:teuthology.orchestra.run.smithi029.stdout: "req_getattr_latency": { 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "req_getfilelock_latency": { 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "req_link_latency": { 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookup_latency": { 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookuphash_latency": { 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupino_latency": { 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.877 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupname_latency": { 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupparent_latency": { 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lookupsnap_latency": { 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.878 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.879 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.879 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.879 INFO:teuthology.orchestra.run.smithi029.stdout: "req_lssnap_latency": { 2024-09-21T07:20:57.879 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.879 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.879 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.879 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "req_mkdir_latency": { 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "req_mknod_latency": { 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "req_mksnap_latency": { 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "req_open_latency": { 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "req_readdir_latency": { 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rename_latency": { 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.881 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "req_renamesnap_latency": { 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "req_snapdiff_latency": { 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.882 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rmdir_latency": { 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rmsnap_latency": { 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "req_rmxattr_latency": { 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.883 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setattr_latency": { 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setdirlayout_latency": { 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setfilelock_latency": { 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.884 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setlayout_latency": { 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "req_setxattr_latency": { 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "req_symlink_latency": { 2024-09-21T07:20:57.885 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "req_unlink_latency": { 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "req_getvxattr_latency": { 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_sessions": { 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "session_count": 1, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "session_add": 2, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "session_remove": 1, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "sessions_open": 1, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "sessions_stale": 0, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "total_load": 0, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "average_load": 0, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "avg_session_uptime": 1803, 2024-09-21T07:20:57.887 INFO:teuthology.orchestra.run.smithi029.stdout: "mdthresh_evicted": 0 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "mempool": { 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_items": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:20:57.888 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:20:57.889 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_items": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_items": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_bytes": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_items": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_bytes": 197463, 2024-09-21T07:20:57.890 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_items": 54, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_items": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bytes": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_items": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_items": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_items": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_bytes": 7496, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_items": 154, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:20:57.891 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_bytes": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_items": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_bytes": 8672, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_items": 13, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_bytes": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_items": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_bytes": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_items": 0 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter": { 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "op_active": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "op_laggy": 0, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "op_send": 2313, 2024-09-21T07:20:57.892 INFO:teuthology.orchestra.run.smithi029.stdout: "op_send_bytes": 21, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "op_resend": 3, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "op_reply": 2313, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "op_latency": { 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 2313, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 1.909969047, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000825754 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "op_inflight": 0, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "oplen_avg": { 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 2313, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 2314 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "op": 2313, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "op_r": 2313, 2024-09-21T07:20:57.893 INFO:teuthology.orchestra.run.smithi029.stdout: "op_w": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "op_rmw": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "op_pg": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_stat": 1512, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_create": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_read": 799, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_write": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_writefull": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_writesame": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_append": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_zero": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_truncate": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_delete": 0, 2024-09-21T07:20:57.894 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_mapext": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_sparse_read": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_clonerange": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_getxattr": 1, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_setxattr": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_rmxattr": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_call": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_watch": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_notify": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_pgls": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "osdop_other": 0, 2024-09-21T07:20:57.895 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_active": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_send": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_resend": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_ping": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "poolop_active": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "poolop_send": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "poolop_resend": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "poolstat_active": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "poolstat_send": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "poolstat_resend": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "statfs_active": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "statfs_send": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "statfs_resend": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "command_active": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "command_send": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "command_resend": 0, 2024-09-21T07:20:57.896 INFO:teuthology.orchestra.run.smithi029.stdout: "map_epoch": 75, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "map_full": 0, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "map_inc": 2, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_sessions": 6, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_session_open": 6, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_session_close": 0, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_laggy": 0, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_wr": 0, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_rd": 2, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_del": 0 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "oft": { 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_objs": 0, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:20:57.897 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_updates": 0, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "omap_total_removes": 0 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "purge_queue": { 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing_ops": 0, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing": 0, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executing_high_water": 0, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executed_ops": 0, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_executed": 0, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "pq_item_in_journal": 0 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:20:57.898 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 104857600, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 2550, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 999757, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 2550, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 2550, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 999757, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.899 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-objecter_bytes": { 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 104857600, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 2313, 2024-09-21T07:20:57.900 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 1433, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 2313, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 1433, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-objecter_ops": { 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 1024, 2024-09-21T07:20:57.901 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 2313, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 2313, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 2313, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 2313, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.902 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 3758096384, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:57.903 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 0, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 0, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-write_buf_throttle-0x55593a4956c0": { 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 3758096384, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 0, 2024-09-21T07:20:57.904 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:57.905 INFO:teuthology.orchestra.run.smithi029.stdout: "trackedop": { 2024-09-21T07:20:57.906 INFO:teuthology.orchestra.run.smithi029.stdout: "slow_ops_count": 0 2024-09-21T07:20:57.906 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:57.906 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:20:57.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:57 smithi052 ceph-mon[34308]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 124 MiB/s wr, 678 op/s 2024-09-21T07:20:58.751 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T07:20:58.751 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T07:20:58.751 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T07:20:58.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T07:20:59.009 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:20:59.726 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:20:59 smithi029 ceph-mon[30983]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 106 MiB/s wr, 672 op/s 2024-09-21T07:20:59.733 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-21T07:20:59.733 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:20:59.733 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 0, 2024-09-21T07:20:59.733 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 2, 2024-09-21T07:20:59.733 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 0, 2024-09-21T07:20:59.733 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 0, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 4, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 0, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.001343881, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.000330963, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.734 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 233, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 228, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 533888, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 139392, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 2, 2024-09-21T07:20:59.735 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 1, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.043441685, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.020566435, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.027398845, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 228, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.028080206, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000123158 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:59.736 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 533888, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 139392 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_messages": 1, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages": 172, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_bytes": 160, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_bytes": 110464, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_created_connections": 3, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_active_connections": 2, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_total_time": 0.017837886, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_send_time": 0.014557542, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_recv_time": 0.001516956, 2024-09-21T07:20:59.737 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 170, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.011030603, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000064885 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: "msgr_send_encrypted_bytes": 110464 2024-09-21T07:20:59.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "cct": { 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "total_workers": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "unhealthy_workers": 0 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "mempool": { 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bloom_filter_items": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:20:59.739 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_items": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blob_items": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:20:59.740 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:20:59.741 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:20:59.741 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:20:59.741 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:20:59.741 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:20:59.741 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_txc_items": 0, 2024-09-21T07:20:59.741 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:20:59.741 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_writing_items": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_bytes": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_items": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:20:59.742 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_bytes": 149007, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_anon_items": 30, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "buffer_meta_items": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bytes": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_items": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mapbl_items": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pglog_items": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_bytes": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_items": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:20:59.743 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_bytes": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "pgmap_items": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_bytes": 968, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_co_items": 2, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_bytes": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_1_items": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_bytes": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "unittest_2_items": 0 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "val": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "max": 104857600, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "get_started": 0, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "get": 230, 2024-09-21T07:20:59.744 INFO:teuthology.orchestra.run.smithi029.stdout: "get_sum": 498586, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_fail": 0, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "get_or_fail_success": 230, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "take": 0, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "take_sum": 0, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "put": 230, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "put_sum": 498586, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "wait": { 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "avgcount": 0, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "sum": 0.000000000, 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: "avgtime": 0.000000000 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:59.745 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-21T07:20:59.746 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-21T07:20:59.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:20:59 smithi066 ceph-mon[34793]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 106 MiB/s wr, 672 op/s 2024-09-21T07:20:59.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:20:59 smithi052 ceph-mon[34308]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 106 MiB/s wr, 672 op/s 2024-09-21T07:21:00.653 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T07:21:00.653 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T07:21:00.653 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T07:21:00.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T07:21:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:21:01.433 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 214098, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 215687, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 85888623, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 168013279, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 15, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 5, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 15.281801454, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 7.922287030, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 15.684492292, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.137586150, 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:01.434 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 215687, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 33.596936264, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000155767 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 360361, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.064453954, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000178 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 85386048, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 85606000 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.435 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1891, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2227, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 590408, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 158629475, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 10, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 7, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.743590752, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.535239386, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.069292620, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.135821384, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2225, 2024-09-21T07:21:01.436 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.740554985, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000332833 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1431, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000326613, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000228 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 388768 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3089, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 3553, 2024-09-21T07:21:01.437 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 970716, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 144560264, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 9, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.784492319, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.521567391, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.129731815, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.139976109, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3551, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.054879495, 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000297065 2024-09-21T07:21:01.438 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3120, 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000728956, 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000233 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-21T07:21:01.439 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2243, 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 51.075327421, 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.022770988 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:01.440 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 38, 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001436925, 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000037813 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 104, 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 103, 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 103, 2024-09-21T07:21:01.441 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.260676271, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002530837 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 1, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 21, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 34, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 4, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 17, 2024-09-21T07:21:01.442 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 13, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 28, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 6, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 11, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 11, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 3, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 142, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 128, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 373, 2024-09-21T07:21:01.443 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 2, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 5, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 1, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 4, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 234, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:01.444 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 3, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 20, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 2472, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 210939, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 210906, 2024-09-21T07:21:01.445 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 2, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 47 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 8, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 10, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 20, 2024-09-21T07:21:01.446 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 10, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 2, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-21T07:21:01.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 211638, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 104750, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 98321, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 113317, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-21T07:21:01.448 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 6429, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 254, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 126, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 118, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 136, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 10, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 8, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 205048682, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 433766298, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3173, 2024-09-21T07:21:01.449 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 640.908066647, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.201988044 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 30, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 45, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 15, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 19, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 22, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 3, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 32, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 65, 2024-09-21T07:21:01.450 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 33, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 11, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 36, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 25, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 135000, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 388898816 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 150, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 2, 2024-09-21T07:21:01.451 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 104, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 16, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 6, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 22, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.022912373, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001041471 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 16, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003729878, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000233117 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:01.452 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 16, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003956884, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000247305 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.453 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000315156, 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000157578 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-21T07:21:01.454 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.455 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.456 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.456 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.456 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-21T07:21:01.456 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.456 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.456 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.456 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 10, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.016663755, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001666375 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.457 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000277298, 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000277298 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.011334653, 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002833663 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-21T07:21:01.458 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.002208276, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001104138 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.459 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.154828133, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.038707033 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001209614, 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001209614 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 9, 2024-09-21T07:21:01.462 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.023363207, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002595911 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 16, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.019877044, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001242315 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:01.463 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 2, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 1, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 39, 2024-09-21T07:21:01.464 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 39, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 677, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 120, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 120, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:01.465 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:01.466 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 347091, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 143, 2024-09-21T07:21:01.467 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 154, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-21T07:21:01.468 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 131812, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 2154, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 4291, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 429671632, 2024-09-21T07:21:01.469 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 37, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 4291, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4291, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 786.452999344, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.183279654 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4291, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4412 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 4291, 2024-09-21T07:21:01.470 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 3, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 4288, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 42, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 3, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 3176, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 60, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 671, 2024-09-21T07:21:01.471 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 84, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-21T07:21:01.472 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-21T07:21:01.473 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 75, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 2, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 12, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 12, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-21T07:21:01.474 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 362, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 14 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-21T07:21:01.475 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 6, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 10, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 10, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 219074, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 57128642, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 219074, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:01.476 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 219074, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 57128642, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:01.477 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4291, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 429672642, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4291, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 429672642, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:01.478 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 4291, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 4291, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4291, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 4291, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.479 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 10, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1010, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 10, 2024-09-21T07:21:01.480 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 3, 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1010, 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.481 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x5597ed00b2b0": { 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 211638, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 429571994, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 211638, 2024-09-21T07:21:01.482 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 3173, 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 429571994, 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:01.483 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.484 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:01.484 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-21T07:21:01.484 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-21T07:21:01.484 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:01.484 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-21T07:21:01.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:01 smithi066 ceph-mon[34793]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 84 MiB/s wr, 593 op/s 2024-09-21T07:21:01.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:01 smithi029 ceph-mon[30983]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 84 MiB/s wr, 593 op/s 2024-09-21T07:21:01.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:01 smithi052 ceph-mon[34308]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 84 MiB/s wr, 593 op/s 2024-09-21T07:21:02.258 INFO:tasks.check_counter:Daemon mds.b mds.exported=2 2024-09-21T07:21:02.258 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-21T07:21:02.258 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T07:21:02.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T07:21:02.515 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:21:03.215 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-21T07:21:03.215 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:03.215 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 364, 2024-09-21T07:21:03.215 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 355, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 662662, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 259350, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 15, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 5, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.057354368, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.023747604, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.039383864, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000412299, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 352, 2024-09-21T07:21:03.216 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.024714819, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000070212 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 144, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000041000, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000284 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 603488, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 147408 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 537, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 793, 2024-09-21T07:21:03.217 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 198548, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 705423, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 9, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.085670544, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.047050034, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.034557728, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.004160172, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 793, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.052638957, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000066379 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.218 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1117, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000263932, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000236 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 383600 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 82, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 82, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 63783, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 64753, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 8, 2024-09-21T07:21:03.219 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 5, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.012522372, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.003176693, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.008804356, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000607575, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 81, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.042309918, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000522344 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 110, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000039073, 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000355 2024-09-21T07:21:03.220 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 50, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001926469, 2024-09-21T07:21:03.221 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000038529 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000017396, 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000008698 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 3, 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 1, 2024-09-21T07:21:03.222 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000202671, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000202671 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 2, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 11, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 11, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-21T07:21:03.223 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 11, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 10, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 4, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 2, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 1, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-21T07:21:03.224 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 1, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 22, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 10738144014, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:03.225 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 0, 2024-09-21T07:21:03.226 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 1 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 2, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:03.227 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-21T07:21:03.228 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 5, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 5, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 2, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-21T07:21:03.229 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 2, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4195732, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.007883933, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001970983 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.230 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 14, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 14, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 12, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 1, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 11, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 11, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 0, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 0, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 1, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 1, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 121004, 2024-09-21T07:21:03.231 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 324812800 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 4, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 3, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 13, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-21T07:21:03.232 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000202671, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000202671 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.233 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.234 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.235 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.236 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.236 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-21T07:21:03.236 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.236 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.236 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.236 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.237 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.238 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-21T07:21:03.239 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-21T07:21:03.240 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.241 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.242 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.243 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 2, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 1, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 1, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 1, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 676, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-21T07:21:03.244 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:03.245 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:03.246 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 255225, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 91, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-21T07:21:03.247 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 154, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 55416, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 213, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:03.248 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 40, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 11730, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 33, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 40, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 40, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.234997249, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.005874931 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.249 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 40, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 62 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 40, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 0, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 40, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 10, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 0, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 4, 2024-09-21T07:21:03.250 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 7, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 6, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 20, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:03.251 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-21T07:21:03.252 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-21T07:21:03.253 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-21T07:21:03.253 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-21T07:21:03.253 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-21T07:21:03.253 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-21T07:21:03.253 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 75, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 2, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 9, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 9, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-21T07:21:03.254 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 14, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 1 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-21T07:21:03.255 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 0, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 0, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 0, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 979, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 819417, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 979, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:03.256 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 979, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 819417, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:03.257 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 40, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 11730, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 40, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 11730, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.258 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 40, 2024-09-21T07:21:03.259 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 40, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 40, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 40, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:03.260 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x555ea6d5f450": { 2024-09-21T07:21:03.261 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 5, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1428, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 5, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 4, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1428, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:03.262 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:03.263 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.263 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:03.263 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-21T07:21:03.263 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-21T07:21:03.263 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:03.263 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-21T07:21:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:03 smithi066 ceph-mon[34793]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 81 MiB/s wr, 617 op/s 2024-09-21T07:21:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:21:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.852 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:03 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:03 smithi029 ceph-mon[30983]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 81 MiB/s wr, 617 op/s 2024-09-21T07:21:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:21:03.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.872 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:03 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:03 smithi052 ceph-mon[34308]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 81 MiB/s wr, 617 op/s 2024-09-21T07:21:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T07:21:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:03.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:03 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:04.161 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T07:21:04.162 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T07:21:04.162 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T07:21:04.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T07:21:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:21:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:21:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:21:04.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:04 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:04.853 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:21:04.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:21:04.854 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:04 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:04.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T07:21:04.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T07:21:04.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:04 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' 2024-09-21T07:21:04.977 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-21T07:21:04.977 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:04.977 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 660, 2024-09-21T07:21:04.977 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 800, 2024-09-21T07:21:04.977 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 729219, 2024-09-21T07:21:04.977 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 288368, 2024-09-21T07:21:04.977 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 8, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.103244682, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.051386830, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.053757056, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.004192481, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 801, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.048938009, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000061096 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:04.978 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 888, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000205402, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000231 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 610992, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 143488 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 15, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 188, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 3950, 2024-09-21T07:21:04.979 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 397176, 2024-09-21T07:21:04.980 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 8, 2024-09-21T07:21:04.980 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-21T07:21:04.980 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.014749673, 2024-09-21T07:21:04.980 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.009396902, 2024-09-21T07:21:04.980 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.003319661, 2024-09-21T07:21:04.980 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000486717, 2024-09-21T07:21:04.980 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 182, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.019265523, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000105854 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 385072 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:04.981 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 200, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 198, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 174056, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 222811, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 14, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.022361226, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.007496272, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.016923754, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000339893, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 199, 2024-09-21T07:21:04.982 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.039784415, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000199921 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 337, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000060301, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000178 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 3872, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 1184 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-21T07:21:04.983 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 46, 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001370988, 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000029804 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:04.984 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:04.985 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-21T07:21:04.985 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000026761, 2024-09-21T07:21:04.985 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000013380 2024-09-21T07:21:04.985 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:04.985 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.985 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-21T07:21:04.985 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 0, 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 0, 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-21T07:21:04.986 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 11, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 10, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 10, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 10, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 0, 2024-09-21T07:21:04.987 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 0, 2024-09-21T07:21:04.988 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 1, 2024-09-21T07:21:04.988 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 0, 2024-09-21T07:21:04.989 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 0, 2024-09-21T07:21:04.989 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-21T07:21:04.989 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-21T07:21:04.989 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:04.989 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:04.989 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 22, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 10738144014, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-21T07:21:04.990 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:04.991 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:04.991 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:04.991 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:04.991 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:04.991 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:04.991 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:04.991 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 0, 2024-09-21T07:21:04.992 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 0 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 1, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:04.993 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-21T07:21:04.994 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 4, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-21T07:21:04.995 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-21T07:21:04.996 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 4, 2024-09-21T07:21:04.996 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-21T07:21:04.996 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-21T07:21:04.996 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 2, 2024-09-21T07:21:04.996 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-21T07:21:04.996 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 2, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4195424, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.007060361, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002353453 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.997 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 13, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 13, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 11, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 12, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 1, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 10, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 10, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 0, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 0, 2024-09-21T07:21:04.998 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 0, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 0, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 117560, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 324816896 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 0, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 0, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 4, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-21T07:21:04.999 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:05.000 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.001 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-21T07:21:05.002 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.003 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:05.004 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.004 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.004 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.004 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.004 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-21T07:21:05.004 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.004 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.005 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.006 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.008 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.009 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.010 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.011 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.012 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:05.013 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 0, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 1, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 0, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 0, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 0, 2024-09-21T07:21:05.014 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 65, 2024-09-21T07:21:05.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:05.015 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-21T07:21:05.015 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:21:05.015 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-21T07:21:05.015 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:05.016 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:05.017 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 230073, 2024-09-21T07:21:05.018 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 73, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 154, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:05.019 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 51184, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 197, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-21T07:21:05.020 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-21T07:21:05.021 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 38, 2024-09-21T07:21:05.021 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 11332, 2024-09-21T07:21:05.021 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 33, 2024-09-21T07:21:05.021 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 38, 2024-09-21T07:21:05.021 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-21T07:21:05.021 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 38, 2024-09-21T07:21:05.021 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.239997189, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006315715 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 38, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 60 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 38, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 0, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 38, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-21T07:21:05.022 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 10, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 3, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 6, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 6, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-21T07:21:05.023 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 20, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-21T07:21:05.025 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 75, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 2, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 8, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 8, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-21T07:21:05.026 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 14, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 1 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:21:05.027 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 0, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 0, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 0, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 871, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 811807, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 871, 2024-09-21T07:21:05.028 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 871, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 811807, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:05.029 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 38, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 11332, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 38, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 11332, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.030 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 38, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 38, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 38, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 38, 2024-09-21T07:21:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x559510253380": { 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 4, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1120, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 4, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 3, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1120, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:05.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:05.035 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-21T07:21:05.035 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-21T07:21:05.035 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:05.035 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-21T07:21:05.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:05 smithi066 ceph-mon[34793]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 75 MiB/s wr, 592 op/s 2024-09-21T07:21:05.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:05 smithi029 ceph-mon[30983]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 75 MiB/s wr, 592 op/s 2024-09-21T07:21:05.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:05 smithi052 ceph-mon[34308]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 75 MiB/s wr, 592 op/s 2024-09-21T07:21:06.096 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T07:21:06.096 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T07:21:06.096 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T07:21:06.097 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T07:21:06.348 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T07:21:06.880 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1044, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1035, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 857088, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 396130, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 5, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 1, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.138178207, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.066292180, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.047810646, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.024389045, 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:06.881 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1034, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.046794502, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000045255 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 588624, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 142048 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3, 2024-09-21T07:21:06.882 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 176, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 716, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 386474, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.012480226, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.009148515, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.001807744, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000064107, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 174, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.007555506, 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000043422 2024-09-21T07:21:06.883 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 385776 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1425, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 1425, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 397312, 2024-09-21T07:21:06.884 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 452333, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.107658344, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.039722433, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.025721375, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.036741643, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1424, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.048065764, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000033754 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.885 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:06.886 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3819, 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.101854243, 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000026670 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-21T07:21:06.887 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 9, 2024-09-21T07:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 2, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 7, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 6, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 3, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:06.889 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-09-21T07:21:06.890 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:06.891 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 0 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:06.892 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:06.893 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-21T07:21:06.894 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 18, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 2, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4225677, 2024-09-21T07:21:06.895 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 4224026, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 18 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 9, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 19, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 10, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 7, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 15, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 8, 2024-09-21T07:21:06.896 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 9, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 19, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 10, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 0, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 0, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 0, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 117472, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 316424192 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 0, 2024-09-21T07:21:06.897 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 0, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 0, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.898 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.899 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.900 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.901 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.902 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.902 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.902 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-21T07:21:06.902 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.902 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.902 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.902 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.903 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.904 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.905 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.906 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.907 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.908 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.909 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-21T07:21:06.910 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 2121, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:06.911 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:06.912 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 181337, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 48, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:06.913 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 154, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 36105, 2024-09-21T07:21:06.914 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 156, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 2222, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 21, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 3, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 2222, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2222, 2024-09-21T07:21:06.915 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 4.244950506, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001910418 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2222, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 2223 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 2222, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 2222, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 0, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 1407, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 0, 2024-09-21T07:21:06.916 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 813, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 1, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 0, 2024-09-21T07:21:06.917 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-21T07:21:06.918 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 75, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 2, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 4, 2024-09-21T07:21:06.919 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 4, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 0, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 2, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 0 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 0, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-21T07:21:06.920 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 2468, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1017482, 2024-09-21T07:21:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 2468, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2468, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1017482, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:06.922 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 2222, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 31378, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2222, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 31378, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.923 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 2222, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 2222, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 2222, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 2222, 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:06.924 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:06.925 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x560d53b25450": { 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-21T07:21:06.926 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-21T07:21:06.927 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-21T07:21:06.928 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-21T07:21:06.928 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-21T07:21:07.687 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T07:21:07.687 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T07:21:07.687 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T07:21:07.687 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T07:21:07.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:07 smithi066 ceph-mon[34793]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 77 MiB/s wr, 590 op/s 2024-09-21T07:21:07.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:07 smithi029 ceph-mon[30983]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 77 MiB/s wr, 590 op/s 2024-09-21T07:21:07.958 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:21:07.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:07 smithi052 ceph-mon[34308]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 77 MiB/s wr, 590 op/s 2024-09-21T07:21:08.501 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-21T07:21:08.501 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:08.501 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1211, 2024-09-21T07:21:08.501 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1027, 2024-09-21T07:21:08.501 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 904857, 2024-09-21T07:21:08.501 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 498795, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 9, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.131841842, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.059403485, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.081291607, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.005100428, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1029, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.058595961, 2024-09-21T07:21:08.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000056944 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1624, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000474152, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000291 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 609280, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 145216 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 74, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 244, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 59809, 2024-09-21T07:21:08.503 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 447442, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 9, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 7, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.023767850, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.013813473, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.008324265, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000454671, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 242, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.027214223, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000112455 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 105, 2024-09-21T07:21:08.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000153586, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000001462 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 385248 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 93, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 99, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 63500, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 121927, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 14, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 6, 2024-09-21T07:21:08.505 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.020561311, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.005678876, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.014649822, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000369400, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 95, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.016750979, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000176326 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 145, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000034501, 2024-09-21T07:21:08.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000237 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 4032, 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 4640 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:08.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 38, 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.001598294, 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000042060 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000031229, 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000015614 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.508 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 2, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 1, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000995007, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000995007 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 1, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 11, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-21T07:21:08.509 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 14, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 14, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 14, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 1, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 1, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 2, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 3, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 1, 2024-09-21T07:21:08.510 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 1, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:08.511 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 22, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 10738144014, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:21:08.512 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 2, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 2, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 2, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-21T07:21:08.513 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 1 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 2, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-21T07:21:08.514 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-21T07:21:08.515 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 5, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-21T07:21:08.516 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 5, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 2, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4195732, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 0, 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-21T07:21:08.517 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.007792143, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001948035 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 0 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 17, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 17, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 0, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 15, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 16, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 1, 2024-09-21T07:21:08.518 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 14, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 14, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 0, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 1, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 1, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 118032, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 324804608 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 3, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 2, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 13, 2024-09-21T07:21:08.519 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000995007, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000995007 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.521 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.522 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.523 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.524 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.524 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.524 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-21T07:21:08.524 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.524 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.524 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-21T07:21:08.525 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.526 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.527 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.528 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-21T07:21:08.530 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.531 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 2, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 1, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 1, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 682, 2024-09-21T07:21:08.532 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:08.533 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:08.534 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 270759, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 91, 2024-09-21T07:21:08.535 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 154, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 68593, 2024-09-21T07:21:08.536 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 318, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 42, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 12135, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 33, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 42, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 42, 2024-09-21T07:21:08.537 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.232997901, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.005547569 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 42, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 66 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 42, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 0, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 42, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-21T07:21:08.538 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 10, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 4, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 7, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 6, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:08.539 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 20, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-21T07:21:08.540 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-21T07:21:08.541 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 75, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 9, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 9, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 18, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 0, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 1 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-21T07:21:08.542 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 1, 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-21T07:21:08.543 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:08.544 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 1374, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 886901, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 1374, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1374, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 886901, 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:08.545 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:08.546 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 42, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 12135, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 42, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 12135, 2024-09-21T07:21:08.547 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-21T07:21:08.548 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 42, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 42, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 42, 2024-09-21T07:21:08.549 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 42, 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-21T07:21:08.551 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x5575790f72b0": { 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:08.552 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 5, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1428, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 5, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4, 2024-09-21T07:21:08.553 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1428, 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-09-21T07:21:08.554 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-21T07:21:08.555 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:08.555 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-21T07:21:09.497 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T07:21:09.497 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T07:21:09.497 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T07:21:09.498 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T07:21:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:21:09.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:09 smithi066 ceph-mon[34793]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 71 MiB/s wr, 541 op/s 2024-09-21T07:21:09.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:09 smithi029 ceph-mon[30983]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 71 MiB/s wr, 541 op/s 2024-09-21T07:21:09.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:09 smithi052 ceph-mon[34308]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 71 MiB/s wr, 541 op/s 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1704, 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1706, 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 172513509, 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 541882, 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 8, 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-09-21T07:21:10.425 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.279820785, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.074268857, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.141394798, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.049193060, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1704, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.055880194, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000032793 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.426 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 798, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 789, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 115777894, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 317166, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-09-21T07:21:10.427 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 5, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.151705063, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.041382364, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.098475156, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.014368059, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 788, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.031302089, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000039723 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.428 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 588240, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 140928 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 799, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 968, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 142848567, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 638381, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 5, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.175206148, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.042772350, 2024-09-21T07:21:10.429 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.101568394, 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.023079230, 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 967, 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.054741960, 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000056610 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.430 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 385888 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4735, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.125932774, 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000026596 2024-09-21T07:21:10.431 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-21T07:21:10.432 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 49, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 2, 2024-09-21T07:21:10.433 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 47, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 45, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 3, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:10.434 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 4, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 234, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-21T07:21:10.435 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:10.436 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:10.437 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-21T07:21:10.438 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 211639, 2024-09-21T07:21:10.439 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 136, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 19, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 205048682, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 433769720, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 433766298, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.440 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 211639 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 22, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 36, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 14, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 10, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 13, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 3, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 49, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 55, 2024-09-21T07:21:10.441 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 6, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 122316, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 330698752 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-21T07:21:10.442 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.443 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.444 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:10.445 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-21T07:21:10.446 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-21T07:21:10.447 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.448 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.449 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.450 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.451 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.452 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.453 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 2, 2024-09-21T07:21:10.454 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 2054, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:10.455 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:10.456 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:10.457 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 239841, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 89, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:10.458 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 154, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 98808, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 1519, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:10.459 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 3052, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 26, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 4, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 3052, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3052, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 99.008164596, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.032440420 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.460 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3052, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 3053 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 3052, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 3052, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1890, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 1159, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-09-21T07:21:10.461 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 2, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:10.462 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-21T07:21:10.463 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-21T07:21:10.464 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 75, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 11, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 11, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:10.465 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:10.466 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 3297, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 430827784, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 3297, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 3297, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 430827784, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.467 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 3052, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 429709642, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 3052, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 429709642, 2024-09-21T07:21:10.468 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:10.469 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 3052, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 3052, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 3052, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 3052, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:10.470 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.471 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x563e07f59520": { 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-21T07:21:10.472 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:10.473 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-21T07:21:11.325 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T07:21:11.325 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T07:21:11.325 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T07:21:11.325 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T07:21:11.584 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:21:11.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:11 smithi066 ceph-mon[34793]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 60 MiB/s wr, 437 op/s 2024-09-21T07:21:11.859 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:11 smithi029 ceph-mon[30983]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 60 MiB/s wr, 437 op/s 2024-09-21T07:21:11.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:11 smithi052 ceph-mon[34308]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 60 MiB/s wr, 437 op/s 2024-09-21T07:21:12.130 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1840, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1275, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1081042, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 557977, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 9, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 5, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.159641030, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.072453590, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.104766313, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.005849684, 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:12.131 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1275, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.071552336, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000056119 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2427, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000516385, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000212 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 618176, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 144752 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 78, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 248, 2024-09-21T07:21:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 60002, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 499922, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 13, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 8, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.022044480, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.012081976, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.007943198, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000489219, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 246, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.020833624, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000084689 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.133 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 111, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000023644, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000213 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 386912 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 99, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 107, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 65755, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 80185, 2024-09-21T07:21:12.134 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 9, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 7, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.018458987, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.005701478, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.012262625, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000627496, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 105, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.018088958, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000172275 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:12.135 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 140, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000032162, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000229 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 3808, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 8688 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:12.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 73, 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.004199226, 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000057523 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 17, 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000398048, 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000023414 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-21T07:21:12.137 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 4, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 4, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.003212362, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000803090 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 11, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-21T07:21:12.138 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 19, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 2, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 17, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 14, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 8, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 4, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 11, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 6, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-21T07:21:12.139 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 2, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 26, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 1, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 2, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 5, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 22, 2024-09-21T07:21:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 10738144014, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 1, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 3, 2024-09-21T07:21:12.141 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 1, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 2, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 4 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 3, 2024-09-21T07:21:12.142 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 2, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 2, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-21T07:21:12.143 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 1, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:12.144 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 18, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 18, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 2, 2024-09-21T07:21:12.145 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4225677, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 0, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 13, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 6.422510160, 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.494039243 2024-09-21T07:21:12.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 0 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 22, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 28, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 6, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 20, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 25, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 5, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 19, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 31, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 12, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-09-21T07:21:12.147 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 5, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 5, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 119008, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 325857280 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 7, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 1, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 4, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 9, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 4, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000286253, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000286253 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.151 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-21T07:21:12.152 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-21T07:21:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.153 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.154 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000288114, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000288114 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.155 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.156 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.157 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.158 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.159 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.160 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.161 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.002637995, 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001318997 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.162 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 1, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 1, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 0, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 3, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 3, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 2057, 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:12.163 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:12.164 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:12.165 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 268981, 2024-09-21T07:21:12.166 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 103, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 154, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:12.167 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 89650, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 454, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 65, 2024-09-21T07:21:12.168 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 43160, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 33, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 65, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 65, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 9.918911538, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.152598639 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 65, 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 89 2024-09-21T07:21:12.169 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 65, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 1, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 64, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 0, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 10, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 1, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 14, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 11, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-21T07:21:12.170 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 14, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 20, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-21T07:21:12.171 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-21T07:21:12.172 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 75, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 10, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 10, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-21T07:21:12.173 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 17, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 0, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 2 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 1, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 2, 2024-09-21T07:21:12.174 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 2, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 2, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 2, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 2013, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1007924, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 2013, 2024-09-21T07:21:12.175 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2013, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1007924, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:12.176 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 65, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 43362, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 65, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 43362, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.177 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 65, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 65, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 65, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 65, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.178 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 2, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 202, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 2, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1, 2024-09-21T07:21:12.179 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 202, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x55688f1152b0": { 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 18, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 31373, 2024-09-21T07:21:12.180 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 18, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 13, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 31373, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:12.181 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-21T07:21:13.002 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-21T07:21:13.002 INFO:tasks.check_counter:Daemon mds.i mds.imported=2 2024-09-21T07:21:13.002 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T07:21:13.003 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T07:21:13.264 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T07:21:13.644 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:13 smithi066 ceph-mon[34793]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 51 MiB/s wr, 311 op/s 2024-09-21T07:21:13.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:13 smithi029 ceph-mon[30983]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 51 MiB/s wr, 311 op/s 2024-09-21T07:21:13.894 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:13 smithi052 ceph-mon[34308]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 51 MiB/s wr, 311 op/s 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 813, 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 815, 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 214717, 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 258598, 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-09-21T07:21:14.011 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.085951339, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.038207759, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.018591982, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.021088645, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 813, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.029336439, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000036084 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.012 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 984, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 975, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 770492, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 377699, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.118837648, 2024-09-21T07:21:14.013 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.049721628, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.043692525, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.027187431, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 974, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.034331491, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000035247 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.014 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 589168, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 143328 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 812, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 985, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 274256, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 644866, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 3, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.125921814, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.056518515, 2024-09-21T07:21:14.015 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.027795059, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.030993619, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 984, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.046556308, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000047313 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T07:21:14.016 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 388240 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3919, 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.123579604, 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000031533 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.017 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-09-21T07:21:14.018 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 0, 2024-09-21T07:21:14.019 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-09-21T07:21:14.020 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-09-21T07:21:14.021 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-09-21T07:21:14.022 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-09-21T07:21:14.023 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-09-21T07:21:14.024 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-09-21T07:21:14.025 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 4, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-09-21T07:21:14.026 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4195424, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 4195283, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 4 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 3, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 3, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 0, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 1, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 1, 2024-09-21T07:21:14.027 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 116904, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 316428288 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-09-21T07:21:14.028 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.029 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.030 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.031 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.032 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.033 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-09-21T07:21:14.034 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.034 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.035 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-09-21T07:21:14.036 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.037 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-09-21T07:21:14.039 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.040 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-09-21T07:21:14.041 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 0, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 1, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 1, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 1, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 1320, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T07:21:14.042 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-09-21T07:21:14.043 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-09-21T07:21:14.044 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 189383, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 50, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-09-21T07:21:14.045 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 7496, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 154, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 8672, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 13, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-09-21T07:21:14.046 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 2357, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 2357, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2357, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2.623976971, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001113269 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-09-21T07:21:14.047 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2357, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2358 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 2357, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 2357, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1542, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 813, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-09-21T07:21:14.048 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-09-21T07:21:14.049 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-09-21T07:21:14.050 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 75, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 2, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 5, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 5, 2024-09-21T07:21:14.051 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-09-21T07:21:14.052 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 2605, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1009397, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:14.053 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 2605, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2605, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1009397, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-09-21T07:21:14.054 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2357, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 1125, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2357, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1125, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.055 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2357, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2357, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2357, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2357, 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:14.056 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:14.057 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x556de99135f0": { 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-09-21T07:21:14.058 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-09-21T07:21:14.059 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-21T07:21:14.060 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-21T07:21:14.827 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T07:21:14.827 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T07:21:14.827 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T07:21:14.840 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T07:21:14.840 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:21:14.841 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:21:14.891 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-21T07:21:14.892 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:21:14.953 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T07:21:15.257 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:15.707 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:15 smithi029 ceph-mon[30983]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 42 MiB/s wr, 167 op/s 2024-09-21T07:21:15.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.800+0000 7fc583e1b640 1 -- 172.21.15.29:0/2470486703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c108cf0 msgr2=0x7fc57c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.800+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2470486703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c108cf0 0x7fc57c10f520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc574009ca0 tx=0x7fc57402a8c0 comp rx=0 tx=0).stop 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.800+0000 7fc583e1b640 1 -- 172.21.15.29:0/2470486703 shutdown_connections 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.800+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2470486703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c108cf0 0x7fc57c10f520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.800+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2470486703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc57c1083a0 0x7fc57c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.800+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2470486703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c102a60 0x7fc57c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.800+0000 7fc583e1b640 1 -- 172.21.15.29:0/2470486703 >> 172.21.15.29:0/2470486703 conn(0x7fc57c079730 msgr2=0x7fc57c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.801+0000 7fc583e1b640 1 -- 172.21.15.29:0/2470486703 shutdown_connections 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.801+0000 7fc583e1b640 1 -- 172.21.15.29:0/2470486703 wait complete. 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.801+0000 7fc583e1b640 1 Processor -- start 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.801+0000 7fc583e1b640 1 -- start start 2024-09-21T07:21:15.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc583e1b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c102a60 0x7fc57c10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc583e1b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c1083a0 0x7fc57c1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc583e1b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc57c108cf0 0x7fc57c110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc583e1b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c113a80 con 0x7fc57c1083a0 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc583e1b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c113900 con 0x7fc57c108cf0 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc583e1b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c113c00 con 0x7fc57c102a60 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c1083a0 0x7fc57c1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c1083a0 0x7fc57c1104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:55694/0 (socket says 172.21.15.29:55694) 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 -- 172.21.15.29:0/2381935618 learned_addr learned my addr 172.21.15.29:0/2381935618 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5823b8640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc57c108cf0 0x7fc57c110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc581bb7640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c102a60 0x7fc57c10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 -- 172.21.15.29:0/2381935618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c102a60 msgr2=0x7fc57c10ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c102a60 0x7fc57c10ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:15.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 -- 172.21.15.29:0/2381935618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc57c108cf0 msgr2=0x7fc57c110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc57c108cf0 0x7fc57c110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 -- 172.21.15.29:0/2381935618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c1a8730 con 0x7fc57c1083a0 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc581bb7640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c102a60 0x7fc57c10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5823b8640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc57c108cf0 0x7fc57c110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc5813b6640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c1083a0 0x7fc57c1104f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00e9c0 tx=0x7fc56c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.802+0000 7fc572ffd640 1 -- 172.21.15.29:0/2381935618 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c00cd80 con 0x7fc57c1083a0 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.803+0000 7fc572ffd640 1 -- 172.21.15.29:0/2381935618 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc56c0054d0 con 0x7fc57c1083a0 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.803+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57c1a8a20 con 0x7fc57c1083a0 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.803+0000 7fc572ffd640 1 -- 172.21.15.29:0/2381935618 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c010430 con 0x7fc57c1083a0 2024-09-21T07:21:15.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.803+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57c1a8fb0 con 0x7fc57c1083a0 2024-09-21T07:21:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.804+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc57c102e70 con 0x7fc57c1083a0 2024-09-21T07:21:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.805+0000 7fc572ffd640 1 -- 172.21.15.29:0/2381935618 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc56c004fb0 con 0x7fc57c1083a0 2024-09-21T07:21:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.806+0000 7fc572ffd640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc5680b6590 0x7fc5680b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.806+0000 7fc581bb7640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc5680b6590 0x7fc5680b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.806+0000 7fc572ffd640 1 -- 172.21.15.29:0/2381935618 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7fc56c0e7810 con 0x7fc57c1083a0 2024-09-21T07:21:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.807+0000 7fc581bb7640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc5680b6590 0x7fc5680b8aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc57c111a00 tx=0x7fc578005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:15.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:15.809+0000 7fc572ffd640 1 -- 172.21.15.29:0/2381935618 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc56c056710 con 0x7fc57c1083a0 2024-09-21T07:21:15.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:15 smithi066 ceph-mon[34793]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 42 MiB/s wr, 167 op/s 2024-09-21T07:21:15.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:15 smithi052 ceph-mon[34308]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 42 MiB/s wr, 167 op/s 2024-09-21T07:21:16.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.010+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc57c1112b0 con 0x7fc57c1083a0 2024-09-21T07:21:16.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.010+0000 7fc572ffd640 1 -- 172.21.15.29:0/2381935618 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v75) ==== 81+0+589 (secure 0 0 0) 0x7fc56c0ae0b0 con 0x7fc57c1083a0 2024-09-21T07:21:16.012 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/726985884 2024-09-22T06:59:55.886513+0000 2024-09-21T07:21:16.012 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/1750085981 2024-09-22T06:59:55.886513+0000 2024-09-21T07:21:16.012 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3835788176 2024-09-22T06:59:55.886513+0000 2024-09-21T07:21:16.012 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/1750085981 2024-09-22T06:59:55.886513+0000 2024-09-21T07:21:16.012 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3563710516 2024-09-22T06:59:55.886513+0000 2024-09-21T07:21:16.013 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3612028397 2024-09-22T06:59:29.378609+0000 2024-09-21T07:21:16.013 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3737682661 2024-09-22T06:59:29.378609+0000 2024-09-21T07:21:16.013 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/675419935 2024-09-22T06:59:29.378609+0000 2024-09-21T07:21:16.013 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1507156797 2024-09-22T06:59:29.378609+0000 2024-09-21T07:21:16.013 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/675419935 2024-09-22T06:59:29.378609+0000 2024-09-21T07:21:16.013 INFO:teuthology.orchestra.run.smithi029.stderr:listed 10 entries 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc5680b6590 msgr2=0x7fc5680b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc5680b6590 0x7fc5680b8aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc57c111a00 tx=0x7fc578005f90 comp rx=0 tx=0).stop 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c1083a0 msgr2=0x7fc57c1104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c1083a0 0x7fc57c1104f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00e9c0 tx=0x7fc56c00ee80 comp rx=0 tx=0).stop 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 shutdown_connections 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fc5680b6590 0x7fc5680b8aa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc57c108cf0 0x7fc57c110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc57c1083a0 0x7fc57c1104f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 --2- 172.21.15.29:0/2381935618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c102a60 0x7fc57c10ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 >> 172.21.15.29:0/2381935618 conn(0x7fc57c079730 msgr2=0x7fc57c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 shutdown_connections 2024-09-21T07:21:16.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:16.013+0000 7fc583e1b640 1 -- 172.21.15.29:0/2381935618 wait complete. 2024-09-21T07:21:16.729 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:16 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2381935618' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:21:16.730 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:21:16.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:21:16.730 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:21:16.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:16 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2381935618' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:21:16.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:16 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2381935618' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T07:21:17.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:17 smithi052 ceph-mon[34308]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 40 MiB/s wr, 100 op/s 2024-09-21T07:21:18.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:17 smithi066 ceph-mon[34793]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 40 MiB/s wr, 100 op/s 2024-09-21T07:21:18.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:17 smithi029 ceph-mon[30983]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 40 MiB/s wr, 100 op/s 2024-09-21T07:21:19.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:19 smithi052 ceph-mon[34308]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 49 MiB/s wr, 127 op/s 2024-09-21T07:21:20.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:19 smithi066 ceph-mon[34793]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 49 MiB/s wr, 127 op/s 2024-09-21T07:21:20.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:19 smithi029 ceph-mon[30983]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 49 MiB/s wr, 127 op/s 2024-09-21T07:21:21.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:21 smithi052 ceph-mon[34308]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 74 MiB/s wr, 256 op/s 2024-09-21T07:21:22.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:21 smithi066 ceph-mon[34793]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 74 MiB/s wr, 256 op/s 2024-09-21T07:21:22.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:21 smithi029 ceph-mon[30983]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 74 MiB/s wr, 256 op/s 2024-09-21T07:21:23.851 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:23 smithi066 ceph-mon[34793]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 167 MiB/s wr, 701 op/s 2024-09-21T07:21:23.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:23 smithi052 ceph-mon[34308]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 167 MiB/s wr, 701 op/s 2024-09-21T07:21:24.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:23 smithi029 ceph-mon[30983]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 167 MiB/s wr, 701 op/s 2024-09-21T07:21:25.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:24 smithi066 ceph-mon[34793]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:21:25.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:24 smithi029 ceph-mon[30983]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:21:25.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:24 smithi052 ceph-mon[34308]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:21:25.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:25 smithi052 ceph-mon[34308]: pgmap v709: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 259 MiB/s wr, 1.14k op/s 2024-09-21T07:21:26.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:25 smithi066 ceph-mon[34793]: pgmap v709: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 259 MiB/s wr, 1.14k op/s 2024-09-21T07:21:26.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:25 smithi029 ceph-mon[30983]: pgmap v709: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 259 MiB/s wr, 1.14k op/s 2024-09-21T07:21:28.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:27 smithi066 ceph-mon[34793]: pgmap v710: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 291 MiB/s wr, 1.32k op/s 2024-09-21T07:21:28.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:27 smithi029 ceph-mon[30983]: pgmap v710: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 291 MiB/s wr, 1.32k op/s 2024-09-21T07:21:28.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:27 smithi052 ceph-mon[34308]: pgmap v710: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 291 MiB/s wr, 1.32k op/s 2024-09-21T07:21:30.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:29 smithi066 ceph-mon[34793]: pgmap v711: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 299 MiB/s wr, 1.37k op/s 2024-09-21T07:21:30.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:29 smithi029 ceph-mon[30983]: pgmap v711: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 299 MiB/s wr, 1.37k op/s 2024-09-21T07:21:30.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:29 smithi052 ceph-mon[34308]: pgmap v711: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 299 MiB/s wr, 1.37k op/s 2024-09-21T07:21:31.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:30 smithi066 ceph-mon[34793]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:21:31.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:30 smithi029 ceph-mon[30983]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:21:31.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:30 smithi052 ceph-mon[34308]: Health check update: 4 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:21:32.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:31 smithi066 ceph-mon[34793]: pgmap v712: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 282 MiB/s wr, 1.31k op/s 2024-09-21T07:21:32.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:31 smithi029 ceph-mon[30983]: pgmap v712: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 282 MiB/s wr, 1.31k op/s 2024-09-21T07:21:32.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:31 smithi052 ceph-mon[34308]: pgmap v712: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 282 MiB/s wr, 1.31k op/s 2024-09-21T07:21:33.876 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T07:21:33.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:21:33.877 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:21:33.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:21:33.900 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-21T07:21:33.957 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:21:33.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:21:33.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:21:34.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:21:34.027 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-09-21T07:21:34.091 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:33 smithi029 ceph-mon[30983]: pgmap v713: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 252 MiB/s wr, 1.15k op/s 2024-09-21T07:21:34.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:33 smithi066 ceph-mon[34793]: pgmap v713: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 252 MiB/s wr, 1.15k op/s 2024-09-21T07:21:34.131 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T07:21:34.142 INFO:tasks.cephadm:Teardown begin 2024-09-21T07:21:34.142 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:21:34.143 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:21:34.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:33 smithi052 ceph-mon[34308]: pgmap v713: 97 pgs: 97 active+clean; 10 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 252 MiB/s wr, 1.15k op/s 2024-09-21T07:21:34.438 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.949+0000 7f0225c25640 1 -- 172.21.15.29:0/3519957469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0220102a60 msgr2=0x7f0220102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.949+0000 7f0225c25640 1 --2- 172.21.15.29:0/3519957469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0220102a60 0x7f0220102e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0210009900 tx=0x7f021002a410 comp rx=0 tx=0).stop 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.949+0000 7f0225c25640 1 -- 172.21.15.29:0/3519957469 shutdown_connections 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.949+0000 7f0225c25640 1 --2- 172.21.15.29:0/3519957469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220108cf0 0x7f022010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.949+0000 7f0225c25640 1 --2- 172.21.15.29:0/3519957469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02201083a0 0x7f02201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.949+0000 7f0225c25640 1 --2- 172.21.15.29:0/3519957469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0220102a60 0x7f0220102e70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.950+0000 7f0225c25640 1 -- 172.21.15.29:0/3519957469 >> 172.21.15.29:0/3519957469 conn(0x7f0220079730 msgr2=0x7f0220079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.950+0000 7f0225c25640 1 -- 172.21.15.29:0/3519957469 shutdown_connections 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.950+0000 7f0225c25640 1 -- 172.21.15.29:0/3519957469 wait complete. 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.950+0000 7f0225c25640 1 Processor -- start 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.950+0000 7f0225c25640 1 -- start start 2024-09-21T07:21:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f0225c25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220102a60 0x7f022019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f0225c25640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02201083a0 0x7f022019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f0225c25640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0220108cf0 0x7f022019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f0225c25640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0220113a80 con 0x7f02201083a0 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f0225c25640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0220113900 con 0x7f0220102a60 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f0225c25640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0220113c00 con 0x7f0220108cf0 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220102a60 0x7f022019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f0216ffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02201083a0 0x7f022019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0220108cf0 0x7f022019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220102a60 0x7f022019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.29:45820/0 (socket says 172.21.15.29:45820) 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 -- 172.21.15.29:0/927103289 learned_addr learned my addr 172.21.15.29:0/927103289 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 -- 172.21.15.29:0/927103289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0220108cf0 msgr2=0x7f022019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0220108cf0 0x7f022019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 -- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02201083a0 msgr2=0x7f022019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02201083a0 0x7f022019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.951+0000 7f021f7fe640 1 -- 172.21.15.29:0/927103289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02201a03a0 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.952+0000 7f021f7fe640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220102a60 0x7f022019a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0210005940 tx=0x7f02100040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.952+0000 7f021d7fa640 1 -- 172.21.15.29:0/927103289 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021003f030 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.952+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02201a0630 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.952+0000 7f021d7fa640 1 -- 172.21.15.29:0/927103289 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02100044c0 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.952+0000 7f021d7fa640 1 -- 172.21.15.29:0/927103289 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0210035070 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.952+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02201a6df0 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.953+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0220102e70 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.955+0000 7f021d7fa640 1 -- 172.21.15.29:0/927103289 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0210042030 con 0x7f0220102a60 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.955+0000 7f021d7fa640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f020c0b6510 0x7f020c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.956+0000 7f0216ffd640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f020c0b6510 0x7f020c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.956+0000 7f021d7fa640 1 -- 172.21.15.29:0/927103289 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f02101078c0 con 0x7f0220102a60 2024-09-21T07:21:34.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.956+0000 7f0216ffd640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f020c0b6510 0x7f020c0b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02080095f0 tx=0x7f0208005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:34.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:34.959+0000 7f021d7fa640 1 -- 172.21.15.29:0/927103289 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02100d24e0 con 0x7f0220102a60 2024-09-21T07:21:35.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.199+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f022019b560 con 0x7f0220102a60 2024-09-21T07:21:35.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.200+0000 7f021d7fa640 1 -- 172.21.15.29:0/927103289 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11959 (secure 0 0 0) 0x7f02100c9030 con 0x7f0220102a60 2024-09-21T07:21:35.202 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:21:35.202 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":33,"btime":"2024-09-21T07:20:54:551531+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:20:54.023511+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:21:35.203 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 33 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f020c0b6510 msgr2=0x7f020c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f020c0b6510 0x7f020c0b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f02080095f0 tx=0x7f0208005f90 comp rx=0 tx=0).stop 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220102a60 msgr2=0x7f022019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220102a60 0x7f022019a430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0210005940 tx=0x7f02100040c0 comp rx=0 tx=0).stop 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 shutdown_connections 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f020c0b6510 0x7f020c0b8a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0220108cf0 0x7f022019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02201083a0 0x7f022019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 --2- 172.21.15.29:0/927103289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0220102a60 0x7f022019a430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:35.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 >> 172.21.15.29:0/927103289 conn(0x7f0220079730 msgr2=0x7f0220101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:35.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 shutdown_connections 2024-09-21T07:21:35.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:35.203+0000 7f0225c25640 1 -- 172.21.15.29:0/927103289 wait complete. 2024-09-21T07:21:35.933 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T07:21:36.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:35 smithi066 ceph-mon[34793]: pgmap v714: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 154 MiB/s wr, 691 op/s 2024-09-21T07:21:36.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:35 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/927103289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:36.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:35 smithi029 ceph-mon[30983]: pgmap v714: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 154 MiB/s wr, 691 op/s 2024-09-21T07:21:36.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:35 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/927103289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:36.199 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:36.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:35 smithi052 ceph-mon[34308]: pgmap v714: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 154 MiB/s wr, 691 op/s 2024-09-21T07:21:36.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:35 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/927103289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 -- 172.21.15.29:0/801685308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec102a60 msgr2=0x7f7aec102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 --2- 172.21.15.29:0/801685308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec102a60 0x7f7aec102e70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8009900 tx=0x7f7ae802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 -- 172.21.15.29:0/801685308 shutdown_connections 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 --2- 172.21.15.29:0/801685308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7aec108cf0 0x7f7aec10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 --2- 172.21.15.29:0/801685308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aec1083a0 0x7f7aec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 --2- 172.21.15.29:0/801685308 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec102a60 0x7f7aec102e70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 -- 172.21.15.29:0/801685308 >> 172.21.15.29:0/801685308 conn(0x7f7aec079730 msgr2=0x7f7aec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 -- 172.21.15.29:0/801685308 shutdown_connections 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.716+0000 7f7af47db640 1 -- 172.21.15.29:0/801685308 wait complete. 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 Processor -- start 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 -- start start 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7aec102a60 0x7f7aec19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec1083a0 0x7f7aec19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aec108cf0 0x7f7aec19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec112960 con 0x7f7aec1083a0 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec1127e0 con 0x7f7aec108cf0 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af47db640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec112ae0 con 0x7f7aec102a60 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af1d76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec1083a0 0x7f7aec19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af1d76640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec1083a0 0x7f7aec19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:47816/0 (socket says 172.21.15.29:47816) 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af1d76640 1 -- 172.21.15.29:0/3543168820 learned_addr learned my addr 172.21.15.29:0/3543168820 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af2d78640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aec108cf0 0x7f7aec19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.717+0000 7f7af2577640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7aec102a60 0x7f7aec19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af1d76640 1 -- 172.21.15.29:0/3543168820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7aec102a60 msgr2=0x7f7aec19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af1d76640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7aec102a60 0x7f7aec19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af1d76640 1 -- 172.21.15.29:0/3543168820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aec108cf0 msgr2=0x7f7aec19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af1d76640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aec108cf0 0x7f7aec19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af1d76640 1 -- 172.21.15.29:0/3543168820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec1a03d0 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af2577640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7aec102a60 0x7f7aec19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af1d76640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec1083a0 0x7f7aec19aa00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00e9c0 tx=0x7f7adc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7ae37fe640 1 -- 172.21.15.29:0/3543168820 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc00ccc0 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec1a06c0 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7ae37fe640 1 -- 172.21.15.29:0/3543168820 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7adc0054d0 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7ae37fe640 1 -- 172.21.15.29:0/3543168820 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc010430 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.718+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec1a6e20 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.719+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec102e70 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.721+0000 7f7ae37fe640 1 -- 172.21.15.29:0/3543168820 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7adc004f20 con 0x7f7aec1083a0 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.722+0000 7f7ae37fe640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7ad80b6510 0x7f7ad80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:36.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.722+0000 7f7af2577640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7ad80b6510 0x7f7ad80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.722+0000 7f7ae37fe640 1 -- 172.21.15.29:0/3543168820 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f7adc0e7f40 con 0x7f7aec1083a0 2024-09-21T07:21:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.723+0000 7f7af2577640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7ad80b6510 0x7f7ad80b8a20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8031440 tx=0x7f7ae8009680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.725+0000 7f7ae37fe640 1 -- 172.21.15.29:0/3543168820 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7adc0ae7e0 con 0x7f7aec1083a0 2024-09-21T07:21:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.972+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7aec19b590 con 0x7f7aec1083a0 2024-09-21T07:21:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.973+0000 7f7ae37fe640 1 -- 172.21.15.29:0/3543168820 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11959 (secure 0 0 0) 0x7f7adc0b2bc0 con 0x7f7aec1083a0 2024-09-21T07:21:36.975 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:21:36.975 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":33,"btime":"2024-09-21T07:20:54:551531+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14751,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3753140533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3753140533},{"type":"v1","addr":"172.21.15.29:6835","nonce":3753140533}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/528626993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":528626993},{"type":"v1","addr":"172.21.15.29:6837","nonce":528626993}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T07:07:33.244548+0000","modified":"2024-09-21T07:20:54.023511+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24655,"mds_2":24653,"mds_3":24640,"mds_4":24629},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14814":{"gid":14814,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6839/3672589136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":3672589136},{"type":"v1","addr":"172.21.15.29:6839","nonce":3672589136}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14826":{"gid":14826,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.29:6841/659023126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":659023126},{"type":"v1","addr":"172.21.15.29:6841","nonce":659023126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24595":{"gid":24595,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6833/3104127935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3104127935},{"type":"v1","addr":"172.21.15.66:6833","nonce":3104127935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6833/2941334623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2941334623},{"type":"v1","addr":"172.21.15.52:6833","nonce":2941334623}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/1200693038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1200693038},{"type":"v1","addr":"172.21.15.66:6835","nonce":1200693038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.52:6835/2243548535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2243548535},{"type":"v1","addr":"172.21.15.52:6835","nonce":2243548535}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24640":{"gid":24640,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.66:6837/2021146216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":2021146216},{"type":"v1","addr":"172.21.15.66:6837","nonce":2021146216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/3446053314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":3446053314},{"type":"v1","addr":"172.21.15.52:6837","nonce":3446053314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.66:6839/3915731427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":3915731427},{"type":"v1","addr":"172.21.15.66:6839","nonce":3915731427}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/1429145114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":1429145114},{"type":"v1","addr":"172.21.15.52:6839","nonce":1429145114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24653,24640,24655,24629]},"id":1}]} 2024-09-21T07:21:36.976 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 33 2024-09-21T07:21:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7ad80b6510 msgr2=0x7f7ad80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7ad80b6510 0x7f7ad80b8a20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8031440 tx=0x7f7ae8009680 comp rx=0 tx=0).stop 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec1083a0 msgr2=0x7f7aec19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec1083a0 0x7f7aec19aa00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00e9c0 tx=0x7f7adc00edc0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 shutdown_connections 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f7ad80b6510 0x7f7ad80b8a20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aec108cf0 0x7f7aec19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec1083a0 0x7f7aec19aa00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 --2- 172.21.15.29:0/3543168820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7aec102a60 0x7f7aec19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.975+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 >> 172.21.15.29:0/3543168820 conn(0x7f7aec079730 msgr2=0x7f7aec101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.976+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 shutdown_connections 2024-09-21T07:21:36.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:36.976+0000 7f7af47db640 1 -- 172.21.15.29:0/3543168820 wait complete. 2024-09-21T07:21:37.909 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T07:21:38.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:37 smithi066 ceph-mon[34793]: pgmap v715: 97 pgs: 97 active+clean; 9.8 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 54 MiB/s wr, 252 op/s 2024-09-21T07:21:38.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:37 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3543168820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:37 smithi029 ceph-mon[30983]: pgmap v715: 97 pgs: 97 active+clean; 9.8 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 54 MiB/s wr, 252 op/s 2024-09-21T07:21:38.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:37 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3543168820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:38.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:37 smithi052 ceph-mon[34308]: pgmap v715: 97 pgs: 97 active+clean; 9.8 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 54 MiB/s wr, 252 op/s 2024-09-21T07:21:38.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:37 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3543168820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T07:21:38.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 -- 172.21.15.29:0/2198217052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c103b60 msgr2=0x7f308c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 --2- 172.21.15.29:0/2198217052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c103b60 0x7f308c103f70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3088009900 tx=0x7f308802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 -- 172.21.15.29:0/2198217052 shutdown_connections 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 --2- 172.21.15.29:0/2198217052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f308c109df0 0x7f308c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 --2- 172.21.15.29:0/2198217052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f308c1094a0 0x7f308c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 --2- 172.21.15.29:0/2198217052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c103b60 0x7f308c103f70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 -- 172.21.15.29:0/2198217052 >> 172.21.15.29:0/2198217052 conn(0x7f308c07b850 msgr2=0x7f308c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 -- 172.21.15.29:0/2198217052 shutdown_connections 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.780+0000 7f30941d2640 1 -- 172.21.15.29:0/2198217052 wait complete. 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 Processor -- start 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 -- start start 2024-09-21T07:21:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f308c103b60 0x7f308c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c1094a0 0x7f308c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f308c109df0 0x7f308c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f308c113ab0 con 0x7f308c1094a0 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f308c113930 con 0x7f308c103b60 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f30941d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f308c113c30 con 0x7f308c109df0 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f309176d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c1094a0 0x7f308c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f309176d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c1094a0 0x7f308c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46458/0 (socket says 172.21.15.29:46458) 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f309176d640 1 -- 172.21.15.29:0/3311073733 learned_addr learned my addr 172.21.15.29:0/3311073733 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f3091f6e640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f308c103b60 0x7f308c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.781+0000 7f309276f640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f308c109df0 0x7f308c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f309176d640 1 -- 172.21.15.29:0/3311073733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f308c109df0 msgr2=0x7f308c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f309176d640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f308c109df0 0x7f308c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f309176d640 1 -- 172.21.15.29:0/3311073733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f308c103b60 msgr2=0x7f308c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f309176d640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f308c103b60 0x7f308c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f309176d640 1 -- 172.21.15.29:0/3311073733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f308c1a0410 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f309176d640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c1094a0 0x7f308c19aa40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f307c00d740 tx=0x7f307c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f3082ffd640 1 -- 172.21.15.29:0/3311073733 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c017070 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f3082ffd640 1 -- 172.21.15.29:0/3311073733 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f307c00de50 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f308c1a0700 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f3082ffd640 1 -- 172.21.15.29:0/3311073733 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c00f620 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.782+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f308c1a6e60 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.783+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f308c103f70 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.785+0000 7f3082ffd640 1 -- 172.21.15.29:0/3311073733 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f307c01a070 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.785+0000 7f3082ffd640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f30780b6510 0x7f30780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.786+0000 7f3082ffd640 1 -- 172.21.15.29:0/3311073733 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f307c0e6c00 con 0x7f308c1094a0 2024-09-21T07:21:38.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.786+0000 7f3091f6e640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f30780b6510 0x7f30780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:38.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.786+0000 7f3091f6e640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f30780b6510 0x7f30780b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3088031440 tx=0x7f3088009560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:38.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.789+0000 7f3082ffd640 1 -- 172.21.15.29:0/3311073733 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f307c0b1880 con 0x7f308c1094a0 2024-09-21T07:21:38.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.988+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f308c10bbf0 con 0x7f308c1094a0 2024-09-21T07:21:38.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.989+0000 7f3082ffd640 1 -- 172.21.15.29:0/3311073733 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22640 (secure 0 0 0) 0x7f307c0b67c0 con 0x7f308c1094a0 2024-09-21T07:21:38.991 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-21T07:21:38.991 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":75,"fsid":"d3a42dd8-77e6-11ef-baf5-efdc52797490","created":"2024-09-21T06:59:06.543850+0000","modified":"2024-09-21T07:07:57.657853+0000","last_up_change":"2024-09-21T07:06:42.258329+0000","last_in_change":"2024-09-21T07:06:19.652007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:02:52.375565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:07:28.778542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:07:31.346462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7e7c8389-ee51-4f2c-802c-d0b9be785e91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6803","nonce":2373940457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6805","nonce":2373940457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6809","nonce":2373940457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":2373940457},{"type":"v1","addr":"172.21.15.29:6807","nonce":2373940457}]},"public_addr":"172.21.15.29:6803/2373940457","cluster_addr":"172.21.15.29:6805/2373940457","heartbeat_back_addr":"172.21.15.29:6809/2373940457","heartbeat_front_addr":"172.21.15.29:6807/2373940457","state":["exists","up"]},{"osd":1,"uuid":"5beaa28d-3076-4361-8a0a-026ee6e24cd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6801","nonce":1978715722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6803","nonce":1978715722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6807","nonce":1978715722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1978715722},{"type":"v1","addr":"172.21.15.52:6805","nonce":1978715722}]},"public_addr":"172.21.15.52:6801/1978715722","cluster_addr":"172.21.15.52:6803/1978715722","heartbeat_back_addr":"172.21.15.52:6807/1978715722","heartbeat_front_addr":"172.21.15.52:6805/1978715722","state":["exists","up"]},{"osd":2,"uuid":"f3e766f0-ba27-44b6-88b9-fb512a6b34cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6801","nonce":318756660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6803","nonce":318756660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6807","nonce":318756660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":318756660},{"type":"v1","addr":"172.21.15.66:6805","nonce":318756660}]},"public_addr":"172.21.15.66:6801/318756660","cluster_addr":"172.21.15.66:6803/318756660","heartbeat_back_addr":"172.21.15.66:6807/318756660","heartbeat_front_addr":"172.21.15.66:6805/318756660","state":["exists","up"]},{"osd":3,"uuid":"d9d78e06-efec-4508-bfdd-eb451ce9f219","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6811","nonce":3285297772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6813","nonce":3285297772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6817","nonce":3285297772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":3285297772},{"type":"v1","addr":"172.21.15.29:6815","nonce":3285297772}]},"public_addr":"172.21.15.29:6811/3285297772","cluster_addr":"172.21.15.29:6813/3285297772","heartbeat_back_addr":"172.21.15.29:6817/3285297772","heartbeat_front_addr":"172.21.15.29:6815/3285297772","state":["exists","up"]},{"osd":4,"uuid":"dde7a9d8-18ea-4717-85b7-d747f1bd620c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6809","nonce":189683591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6811","nonce":189683591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6815","nonce":189683591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":189683591},{"type":"v1","addr":"172.21.15.52:6813","nonce":189683591}]},"public_addr":"172.21.15.52:6809/189683591","cluster_addr":"172.21.15.52:6811/189683591","heartbeat_back_addr":"172.21.15.52:6815/189683591","heartbeat_front_addr":"172.21.15.52:6813/189683591","state":["exists","up"]},{"osd":5,"uuid":"d329891b-ec44-4ca8-bc4b-a770ba76ea24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6809","nonce":3149868590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6811","nonce":3149868590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6815","nonce":3149868590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3149868590},{"type":"v1","addr":"172.21.15.66:6813","nonce":3149868590}]},"public_addr":"172.21.15.66:6809/3149868590","cluster_addr":"172.21.15.66:6811/3149868590","heartbeat_back_addr":"172.21.15.66:6815/3149868590","heartbeat_front_addr":"172.21.15.66:6813/3149868590","state":["exists","up"]},{"osd":6,"uuid":"69cab741-228d-4d88-80e0-a871ae498271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6819","nonce":3038729725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6821","nonce":3038729725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6825","nonce":3038729725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":3038729725},{"type":"v1","addr":"172.21.15.29:6823","nonce":3038729725}]},"public_addr":"172.21.15.29:6819/3038729725","cluster_addr":"172.21.15.29:6821/3038729725","heartbeat_back_addr":"172.21.15.29:6825/3038729725","heartbeat_front_addr":"172.21.15.29:6823/3038729725","state":["exists","up"]},{"osd":7,"uuid":"54a8f327-cf53-4753-8b91-a19aa92fd237","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6817","nonce":4067251695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6819","nonce":4067251695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6823","nonce":4067251695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4067251695},{"type":"v1","addr":"172.21.15.52:6821","nonce":4067251695}]},"public_addr":"172.21.15.52:6817/4067251695","cluster_addr":"172.21.15.52:6819/4067251695","heartbeat_back_addr":"172.21.15.52:6823/4067251695","heartbeat_front_addr":"172.21.15.52:6821/4067251695","state":["exists","up"]},{"osd":8,"uuid":"5542b251-2218-4751-bee7-006dfa5ce8e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6817","nonce":1991639723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6819","nonce":1991639723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6823","nonce":1991639723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1991639723},{"type":"v1","addr":"172.21.15.66:6821","nonce":1991639723}]},"public_addr":"172.21.15.66:6817/1991639723","cluster_addr":"172.21.15.66:6819/1991639723","heartbeat_back_addr":"172.21.15.66:6823/1991639723","heartbeat_front_addr":"172.21.15.66:6821/1991639723","state":["exists","up"]},{"osd":9,"uuid":"2be711e7-2f39-4acb-bb4b-c8cbfdfa9909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6827","nonce":2032308590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6829","nonce":2032308590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6833","nonce":2032308590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2032308590},{"type":"v1","addr":"172.21.15.29:6831","nonce":2032308590}]},"public_addr":"172.21.15.29:6827/2032308590","cluster_addr":"172.21.15.29:6829/2032308590","heartbeat_back_addr":"172.21.15.29:6833/2032308590","heartbeat_front_addr":"172.21.15.29:6831/2032308590","state":["exists","up"]},{"osd":10,"uuid":"fe637203-8937-4364-b1d8-010c5f1f238c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6825","nonce":1774195182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6827","nonce":1774195182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6831","nonce":1774195182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1774195182},{"type":"v1","addr":"172.21.15.52:6829","nonce":1774195182}]},"public_addr":"172.21.15.52:6825/1774195182","cluster_addr":"172.21.15.52:6827/1774195182","heartbeat_back_addr":"172.21.15.52:6831/1774195182","heartbeat_front_addr":"172.21.15.52:6829/1774195182","state":["exists","up"]},{"osd":11,"uuid":"7c6b8370-2b17-447f-b315-c7c04fb51288","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6825","nonce":3573709450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6827","nonce":3573709450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6831","nonce":3573709450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":3573709450},{"type":"v1","addr":"172.21.15.66:6829","nonce":3573709450}]},"public_addr":"172.21.15.66:6825/3573709450","cluster_addr":"172.21.15.66:6827/3573709450","heartbeat_back_addr":"172.21.15.66:6831/3573709450","heartbeat_front_addr":"172.21.15.66:6829/3573709450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:01:58.445147+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:25.200787+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:02:50.250610+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:17.312654+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:03:42.744225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:08.035618+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:34.200200+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:04:59.436424+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:24.545652+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:05:51.306304+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:16.213912+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:06:40.636521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/726985884":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6800/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3835788176":"2024-09-22T06:59:55.886513+0000","172.21.15.29:6801/1750085981":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3563710516":"2024-09-22T06:59:55.886513+0000","172.21.15.29:0/3612028397":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/3737682661":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6801/675419935":"2024-09-22T06:59:29.378609+0000","172.21.15.29:0/1507156797":"2024-09-22T06:59:29.378609+0000","172.21.15.29:6800/675419935":"2024-09-22T06:59:29.378609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:21:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f30780b6510 msgr2=0x7f30780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f30780b6510 0x7f30780b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3088031440 tx=0x7f3088009560 comp rx=0 tx=0).stop 2024-09-21T07:21:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c1094a0 msgr2=0x7f308c19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c1094a0 0x7f308c19aa40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f307c00d740 tx=0x7f307c00dc00 comp rx=0 tx=0).stop 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 shutdown_connections 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f30780b6510 0x7f30780b8a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f308c109df0 0x7f308c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f308c1094a0 0x7f308c19aa40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 --2- 172.21.15.29:0/3311073733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f308c103b60 0x7f308c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 >> 172.21.15.29:0/3311073733 conn(0x7f308c07b850 msgr2=0x7f308c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 shutdown_connections 2024-09-21T07:21:38.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:38.992+0000 7f30941d2640 1 -- 172.21.15.29:0/3311073733 wait complete. 2024-09-21T07:21:39.715 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T07:21:39.977 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:40.100 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:39 smithi029 ceph-mon[30983]: pgmap v716: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 85 op/s 2024-09-21T07:21:40.100 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:39 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/3311073733' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:21:40.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:39 smithi066 ceph-mon[34793]: pgmap v716: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 85 op/s 2024-09-21T07:21:40.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:39 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/3311073733' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:21:40.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:39 smithi052 ceph-mon[34308]: pgmap v716: 97 pgs: 97 active+clean; 9.3 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 13 MiB/s wr, 85 op/s 2024-09-21T07:21:40.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:39 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/3311073733' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T07:21:40.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 -- 172.21.15.29:0/3458806287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42081083b0 msgr2=0x7f42081087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 --2- 172.21.15.29:0/3458806287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42081083b0 0x7f42081087c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f41f0009900 tx=0x7f41f002a410 comp rx=0 tx=0).stop 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 -- 172.21.15.29:0/3458806287 shutdown_connections 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 --2- 172.21.15.29:0/3458806287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4208108d00 0x7f420810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 --2- 172.21.15.29:0/3458806287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42081083b0 0x7f42081087c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 --2- 172.21.15.29:0/3458806287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4208102a70 0x7f4208102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 -- 172.21.15.29:0/3458806287 >> 172.21.15.29:0/3458806287 conn(0x7f4208079730 msgr2=0x7f4208079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 -- 172.21.15.29:0/3458806287 shutdown_connections 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.473+0000 7f420dbce640 1 -- 172.21.15.29:0/3458806287 wait complete. 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 Processor -- start 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 -- start start 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4208102a70 0x7f4208199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42081083b0 0x7f42081999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4208108d00 0x7f420819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:40.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4208112970 con 0x7f4208108d00 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42081127f0 con 0x7f42081083b0 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f420dbce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4208112af0 con 0x7f4208102a70 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4208108d00 0x7f420819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f42077fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4208102a70 0x7f4208199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4208108d00 0x7f420819ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46472/0 (socket says 172.21.15.29:46472) 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 -- 172.21.15.29:0/2835466662 learned_addr learned my addr 172.21.15.29:0/2835466662 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f41fffff640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42081083b0 0x7f42081999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 -- 172.21.15.29:0/2835466662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4208102a70 msgr2=0x7f4208199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4208102a70 0x7f4208199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 -- 172.21.15.29:0/2835466662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42081083b0 msgr2=0x7f42081999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42081083b0 0x7f42081999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f4207fff640 1 -- 172.21.15.29:0/2835466662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420819f390 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.474+0000 7f42077fe640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4208102a70 0x7f4208199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.475+0000 7f4207fff640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4208108d00 0x7f420819ec60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f420000efd0 tx=0x7f420000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.475+0000 7f42057fa640 1 -- 172.21.15.29:0/2835466662 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200003b70 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.475+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420819f680 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.475+0000 7f42057fa640 1 -- 172.21.15.29:0/2835466662 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4200003d10 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.475+0000 7f42057fa640 1 -- 172.21.15.29:0/2835466662 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42000108a0 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.475+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42081a5de0 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.476+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4208103cf0 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.477+0000 7f42057fa640 1 -- 172.21.15.29:0/2835466662 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4200004b40 con 0x7f4208108d00 2024-09-21T07:21:40.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.478+0000 7f42057fa640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f41f40b6510 0x7f41f40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:40.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.478+0000 7f42077fe640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f41f40b6510 0x7f41f40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:40.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.478+0000 7f42057fa640 1 -- 172.21.15.29:0/2835466662 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8211+0+0 (secure 0 0 0) 0x7f42000e7a10 con 0x7f4208108d00 2024-09-21T07:21:40.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.479+0000 7f42077fe640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f41f40b6510 0x7f41f40b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009fc0 tx=0x7f41f8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:40.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.481+0000 7f42057fa640 1 -- 172.21.15.29:0/2835466662 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42000ae2b0 con 0x7f4208108d00 2024-09-21T07:21:40.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.713+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4208102e80 con 0x7f4208108d00 2024-09-21T07:21:40.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.716+0000 7f42057fa640 1 -- 172.21.15.29:0/2835466662 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) ==== 161+0+0 (secure 0 0 0) 0x7f4208102e80 con 0x7f4208108d00 2024-09-21T07:21:40.717 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:21:40.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.719+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f41f40b6510 msgr2=0x7f41f40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.719+0000 7f420dbce640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f41f40b6510 0x7f41f40b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009fc0 tx=0x7f41f8005f90 comp rx=0 tx=0).stop 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.719+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4208108d00 msgr2=0x7f420819ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.719+0000 7f420dbce640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4208108d00 0x7f420819ec60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f420000efd0 tx=0x7f420000c6a0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 shutdown_connections 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f41f40b6510 0x7f41f40b8a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4208108d00 0x7f420819ec60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42081083b0 0x7f42081999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 --2- 172.21.15.29:0/2835466662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4208102a70 0x7f4208199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 >> 172.21.15.29:0/2835466662 conn(0x7f4208079730 msgr2=0x7f42081044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 shutdown_connections 2024-09-21T07:21:40.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:40.721+0000 7f420dbce640 1 -- 172.21.15.29:0/2835466662 wait complete. 2024-09-21T07:21:41.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2835466662' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:21:41.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mon[34793]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:21:41.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mon[34793]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:21:41.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2835466662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:21:41.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mon[34793]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:21:41.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mon[34793]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T07:21:41.102 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i[64504]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.102 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i[64504]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.102 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mds[64508]: -- 172.21.15.66:0/3280745844 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5607f5f39860 con 0x5607fa0e1600 2024-09-21T07:21:41.102 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i[64504]: starting mds.i at 2024-09-21T07:21:41.102 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l[63683]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.103 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l[63683]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.103 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mds[63687]: -- 172.21.15.66:0/1853909296 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c3729bd860 con 0x55c376b65a80 2024-09-21T07:21:41.103 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l[63683]: starting mds.l at 2024-09-21T07:21:41.103 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c[64222]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.103 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c[64222]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.103 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mds[64226]: -- 172.21.15.66:0/3679940085 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cdc8c79860 con 0x55cdcce21600 2024-09-21T07:21:41.103 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c[64222]: starting mds.c at 2024-09-21T07:21:41.104 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f[63950]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.104 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f[63950]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.104 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-mds[63954]: -- 172.21.15.66:0/2577395018 <== mon.1 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f002bf860 con 0x555f04467180 2024-09-21T07:21:41.104 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:21:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f[63950]: starting mds.f at 2024-09-21T07:21:41.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T07:21:40.714+0000 7fb7d79a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:21:41.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2835466662' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:21:41.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mon[30983]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:21:41.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mon[30983]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:21:41.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2835466662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:21:41.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mon[30983]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:21:41.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mon[30983]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T07:21:41.122 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g[69911]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.122 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g[69911]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.122 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mds[69916]: -- 172.21.15.29:0/15636512 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584fab49860 con 0x5584fecf1600 2024-09-21T07:21:41.122 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g[69911]: starting mds.g at 2024-09-21T07:21:41.122 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a[70291]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.122 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a[70291]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.122 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-mds[70295]: -- 172.21.15.29:0/1427622659 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c194a01860 con 0x55c198ba9600 2024-09-21T07:21:41.123 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:21:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a[70291]: starting mds.a at 2024-09-21T07:21:41.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2835466662' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T07:21:41.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mon[34308]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T07:21:41.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mon[34308]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:21:41.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2835466662' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T07:21:41.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mon[34308]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T07:21:41.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mon[34308]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mds[62260]: -- 172.21.15.52:0/945762140 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5573d7691860 con 0x5573db839180 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: starting mds.b at 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k[61419]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k[61419]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mds[61423]: -- 172.21.15.52:0/963584746 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55db9ceecea0 con 0x55dba108b180 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mds[61423]: -- 172.21.15.52:0/963584746 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55db9cee3860 con 0x55dba108b180 2024-09-21T07:21:41.244 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k[61419]: starting mds.k at 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e[61704]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e[61704]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mds[61708]: -- 172.21.15.52:0/1199999909 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ac2e31860 con 0x557ac6fd9600 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e[61704]: starting mds.e at 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h[61985]: ignoring --setuser ceph since I am not root 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h[61985]: ignoring --setgroup ceph since I am not root 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-mds[61989]: -- 172.21.15.52:0/2677614229 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556218f37860 con 0x55621d0df180 2024-09-21T07:21:41.245 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:21:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h[61985]: starting mds.h at 2024-09-21T07:21:41.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:21:41.669 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:42.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: pgmap v717: 97 pgs: 97 active+clean; 9.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 KiB/s wr, 36 op/s 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6832/1538417805,v1:172.21.15.52:6834/1538417805] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6833/778988764,v1:172.21.15.52:6835/778988764] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.29:6838/4208657967,v1:172.21.15.29:6839/4208657967] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6832/4261664985,v1:172.21.15.66:6833/4261664985] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.29:6840/4101135196,v1:172.21.15.29:6841/4101135196] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6836/1423999322,v1:172.21.15.52:6839/1423999322] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.52:6837/3664336913,v1:172.21.15.52:6838/3664336913] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6834/1356486208,v1:172.21.15.66:6835/1356486208] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6836/791120098,v1:172.21.15.66:6837/791120098] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: mds.? [v2:172.21.15.66:6838/3576881593,v1:172.21.15.66:6839/3576881593] up:boot 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:21:42.102 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:21:42.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:21:42.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:21:42.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:21:42.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:21:42.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:21:42.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:21:42.103 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:41 smithi066 ceph-mon[34793]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: pgmap v717: 97 pgs: 97 active+clean; 9.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 KiB/s wr, 36 op/s 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6832/1538417805,v1:172.21.15.52:6834/1538417805] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6833/778988764,v1:172.21.15.52:6835/778988764] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.29:6838/4208657967,v1:172.21.15.29:6839/4208657967] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6832/4261664985,v1:172.21.15.66:6833/4261664985] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.29:6840/4101135196,v1:172.21.15.29:6841/4101135196] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6836/1423999322,v1:172.21.15.52:6839/1423999322] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.52:6837/3664336913,v1:172.21.15.52:6838/3664336913] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6834/1356486208,v1:172.21.15.66:6835/1356486208] up:boot 2024-09-21T07:21:42.105 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6836/791120098,v1:172.21.15.66:6837/791120098] up:boot 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: mds.? [v2:172.21.15.66:6838/3576881593,v1:172.21.15.66:6839/3576881593] up:boot 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:21:42.106 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:41 smithi029 ceph-mon[30983]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:21:42.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 -- 172.21.15.29:0/3727336035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d8101ef0 msgr2=0x7f08d8102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/3727336035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d8101ef0 0x7f08d8102300 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009900 tx=0x7f08cc02a410 comp rx=0 tx=0).stop 2024-09-21T07:21:42.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 -- 172.21.15.29:0/3727336035 shutdown_connections 2024-09-21T07:21:42.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/3727336035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08d8106a30 0x7f08d8110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/3727336035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d81060e0 0x7f08d81064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/3727336035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d8101ef0 0x7f08d8102300 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 -- 172.21.15.29:0/3727336035 >> 172.21.15.29:0/3727336035 conn(0x7f08d8077a10 msgr2=0x7f08d8077e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 -- 172.21.15.29:0/3727336035 shutdown_connections 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 -- 172.21.15.29:0/3727336035 wait complete. 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 Processor -- start 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.198+0000 7f08ddfa2640 1 -- start start 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08ddfa2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d8101ef0 0x7f08d8102e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08ddfa2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d81060e0 0x7f08d81033d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08ddfa2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08d8106a30 0x7f08d8103910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08ddfa2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8113900 con 0x7f08d81060e0 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08ddfa2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8113780 con 0x7f08d8101ef0 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08ddfa2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f08d8113a80 con 0x7f08d8106a30 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d81060e0 0x7f08d81033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d81060e0 0x7f08d81033d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46520/0 (socket says 172.21.15.29:46520) 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 -- 172.21.15.29:0/2933667525 learned_addr learned my addr 172.21.15.29:0/2933667525 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08dd7a1640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08d8106a30 0x7f08d8103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08dcfa0640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d8101ef0 0x7f08d8102e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 -- 172.21.15.29:0/2933667525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08d8106a30 msgr2=0x7f08d8103910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08d8106a30 0x7f08d8103910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 -- 172.21.15.29:0/2933667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d8101ef0 msgr2=0x7f08d8102e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d8101ef0 0x7f08d8102e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 -- 172.21.15.29:0/2933667525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d81a8630 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.199+0000 7f08d7fff640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d81060e0 0x7f08d81033d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f08c400d950 tx=0x7f08c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.200+0000 7f08d5ffb640 1 -- 172.21.15.29:0/2933667525 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4017070 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.200+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d81a8920 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.200+0000 7f08d5ffb640 1 -- 172.21.15.29:0/2933667525 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08c4009c30 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.200+0000 7f08d5ffb640 1 -- 172.21.15.29:0/2933667525 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c40047a0 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.200+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d81a8eb0 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.201+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d8102300 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.202+0000 7f08d5ffb640 1 -- 172.21.15.29:0/2933667525 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f08c4004020 con 0x7f08d81060e0 2024-09-21T07:21:42.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.203+0000 7f08d5ffb640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08c80b6510 0x7f08c80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:42.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.204+0000 7f08dcfa0640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08c80b6510 0x7f08c80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:42.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.204+0000 7f08d5ffb640 1 -- 172.21.15.29:0/2933667525 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8641+0+0 (secure 0 0 0) 0x7f08c40e7110 con 0x7f08d81060e0 2024-09-21T07:21:42.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.204+0000 7f08dcfa0640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08c80b6510 0x7f08c80b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:42.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.208+0000 7f08d5ffb640 1 -- 172.21.15.29:0/2933667525 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08c4020020 con 0x7f08d81060e0 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: pgmap v717: 97 pgs: 97 active+clean; 9.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.0 KiB/s wr, 36 op/s 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6832/1538417805,v1:172.21.15.52:6834/1538417805] up:boot 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6833/778988764,v1:172.21.15.52:6835/778988764] up:boot 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.29:6838/4208657967,v1:172.21.15.29:6839/4208657967] up:boot 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6832/4261664985,v1:172.21.15.66:6833/4261664985] up:boot 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.29:6840/4101135196,v1:172.21.15.29:6841/4101135196] up:boot 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6836/1423999322,v1:172.21.15.52:6839/1423999322] up:boot 2024-09-21T07:21:42.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.52:6837/3664336913,v1:172.21.15.52:6838/3664336913] up:boot 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6834/1356486208,v1:172.21.15.66:6835/1356486208] up:boot 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6836/791120098,v1:172.21.15.66:6837/791120098] up:boot 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: mds.? [v2:172.21.15.66:6838/3576881593,v1:172.21.15.66:6839/3576881593] up:boot 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T07:21:42.244 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T07:21:42.245 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:41 smithi052 ceph-mon[34308]: from='mgr.14152 172.21.15.29:0/219161819' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T07:21:42.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.436+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f08d802e640 con 0x7f08d81060e0 2024-09-21T07:21:42.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.849+0000 7f08d5ffb640 1 -- 172.21.15.29:0/2933667525 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7f08c40ad800 con 0x7f08d81060e0 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08c80b6510 msgr2=0x7f08c80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08c80b6510 0x7f08c80b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f08cc000c00 tx=0x7f08cc031400 comp rx=0 tx=0).stop 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d81060e0 msgr2=0x7f08d81033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d81060e0 0x7f08d81033d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f08c400d950 tx=0x7f08c400de10 comp rx=0 tx=0).stop 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 shutdown_connections 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f08c80b6510 0x7f08c80b8a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08d8106a30 0x7f08d8103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08d81060e0 0x7f08d81033d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 --2- 172.21.15.29:0/2933667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08d8101ef0 0x7f08d8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 >> 172.21.15.29:0/2933667525 conn(0x7f08d8077a10 msgr2=0x7f08d81073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 shutdown_connections 2024-09-21T07:21:42.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:42.853+0000 7f08ddfa2640 1 -- 172.21.15.29:0/2933667525 wait complete. 2024-09-21T07:21:43.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:42 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2933667525' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:21:43.144 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:42 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2933667525' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:21:43.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:42 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2933667525' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T07:21:43.766 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:21:44.030 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:43 smithi029 ceph-mon[30983]: pgmap v719: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 54 op/s 2024-09-21T07:21:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:43 smithi029 ceph-mon[30983]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:21:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:43 smithi029 ceph-mon[30983]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:21:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:43 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2933667525' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:21:44.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:43 smithi029 ceph-mon[30983]: fsmap 12 up:standby 2024-09-21T07:21:44.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:43 smithi052 ceph-mon[34308]: pgmap v719: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 54 op/s 2024-09-21T07:21:44.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:43 smithi052 ceph-mon[34308]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:21:44.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:43 smithi052 ceph-mon[34308]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:21:44.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:43 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2933667525' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:21:44.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:43 smithi052 ceph-mon[34308]: fsmap 12 up:standby 2024-09-21T07:21:44.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:43 smithi066 ceph-mon[34793]: pgmap v719: 97 pgs: 97 active+clean; 8.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.1 KiB/s wr, 54 op/s 2024-09-21T07:21:44.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:43 smithi066 ceph-mon[34793]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T07:21:44.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:43 smithi066 ceph-mon[34793]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T07:21:44.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:43 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2933667525' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T07:21:44.352 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:43 smithi066 ceph-mon[34793]: fsmap 12 up:standby 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 -- 172.21.15.29:0/1630479293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80109e40 msgr2=0x7f4f80110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 --2- 172.21.15.29:0/1630479293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80109e40 0x7f4f80110670 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009ca0 tx=0x7f4f7802a8c0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 -- 172.21.15.29:0/1630479293 shutdown_connections 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 --2- 172.21.15.29:0/1630479293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80109e40 0x7f4f80110670 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 --2- 172.21.15.29:0/1630479293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f801094f0 0x7f4f80109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 --2- 172.21.15.29:0/1630479293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f80103bb0 0x7f4f80103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 -- 172.21.15.29:0/1630479293 >> 172.21.15.29:0/1630479293 conn(0x7f4f800ff600 msgr2=0x7f4f80101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 -- 172.21.15.29:0/1630479293 shutdown_connections 2024-09-21T07:21:44.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.528+0000 7f4f84987640 1 -- 172.21.15.29:0/1630479293 wait complete. 2024-09-21T07:21:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 Processor -- start 2024-09-21T07:21:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 -- start start 2024-09-21T07:21:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80103bb0 0x7f4f8019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f801094f0 0x7f4f8019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f80109e40 0x7f4f801a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80113b00 con 0x7f4f80103bb0 2024-09-21T07:21:44.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80113980 con 0x7f4f801094f0 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f84987640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80113c80 con 0x7f4f80109e40 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f7e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80103bb0 0x7f4f8019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f7e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80103bb0 0x7f4f8019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46538/0 (socket says 172.21.15.29:46538) 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.529+0000 7f4f7e59c640 1 -- 172.21.15.29:0/2021040837 learned_addr learned my addr 172.21.15.29:0/2021040837 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7ed9d640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f80109e40 0x7f4f801a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7dd9b640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f801094f0 0x7f4f8019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7e59c640 1 -- 172.21.15.29:0/2021040837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f80109e40 msgr2=0x7f4f801a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7e59c640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f80109e40 0x7f4f801a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7e59c640 1 -- 172.21.15.29:0/2021040837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f801094f0 msgr2=0x7f4f8019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7e59c640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f801094f0 0x7f4f8019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7e59c640 1 -- 172.21.15.29:0/2021040837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f801a2600 con 0x7f4f80103bb0 2024-09-21T07:21:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f7e59c640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80103bb0 0x7f4f8019c690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000e9f0 tx=0x7f4f7000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f6f7fe640 1 -- 172.21.15.29:0/2021040837 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000cd80 con 0x7f4f80103bb0 2024-09-21T07:21:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f801a28f0 con 0x7f4f80103bb0 2024-09-21T07:21:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f6f7fe640 1 -- 172.21.15.29:0/2021040837 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f700108e0 con 0x7f4f80103bb0 2024-09-21T07:21:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f6f7fe640 1 -- 172.21.15.29:0/2021040837 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70018980 con 0x7f4f80103bb0 2024-09-21T07:21:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.530+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f801a9050 con 0x7f4f80103bb0 2024-09-21T07:21:44.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.532+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f80103fc0 con 0x7f4f80103bb0 2024-09-21T07:21:44.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.533+0000 7f4f6f7fe640 1 -- 172.21.15.29:0/2021040837 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4f70010430 con 0x7f4f80103bb0 2024-09-21T07:21:44.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.534+0000 7f4f6f7fe640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4f680b6510 0x7f4f680b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:44.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.534+0000 7f4f7dd9b640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4f680b6510 0x7f4f680b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:44.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.534+0000 7f4f6f7fe640 1 -- 172.21.15.29:0/2021040837 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8641+0+0 (secure 0 0 0) 0x7f4f700e7ca0 con 0x7f4f80103bb0 2024-09-21T07:21:44.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.535+0000 7f4f7dd9b640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4f680b6510 0x7f4f680b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4f80105ba0 tx=0x7f4f7400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:44.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.537+0000 7f4f6f7fe640 1 -- 172.21.15.29:0/2021040837 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f700b2710 con 0x7f4f80103bb0 2024-09-21T07:21:44.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.725+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4f801a9380 con 0x7f4f80103bb0 2024-09-21T07:21:44.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.857+0000 7f4f6f7fe640 1 -- 172.21.15.29:0/2021040837 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f4f700b7650 con 0x7f4f80103bb0 2024-09-21T07:21:44.859 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:21:44.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4f680b6510 msgr2=0x7f4f680b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4f680b6510 0x7f4f680b8a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4f80105ba0 tx=0x7f4f7400a250 comp rx=0 tx=0).stop 2024-09-21T07:21:44.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80103bb0 msgr2=0x7f4f8019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:44.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80103bb0 0x7f4f8019c690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000e9f0 tx=0x7f4f7000eeb0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 shutdown_connections 2024-09-21T07:21:44.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7f4f680b6510 0x7f4f680b8a20 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4f80105ba0 tx=0x7f4f7400a250 comp rx=0 tx=0).stop 2024-09-21T07:21:44.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f80109e40 0x7f4f801a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f801094f0 0x7f4f8019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 --2- 172.21.15.29:0/2021040837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f80103bb0 0x7f4f8019c690 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:44.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 >> 172.21.15.29:0/2021040837 conn(0x7f4f800ff600 msgr2=0x7f4f80107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:44.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.862+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 shutdown_connections 2024-09-21T07:21:44.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:44.863+0000 7f4f84987640 1 -- 172.21.15.29:0/2021040837 wait complete. 2024-09-21T07:21:45.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:44 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2021040837' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:21:45.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:44 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2021040837' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:21:45.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:44 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2021040837' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:21:45.487 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:21:45.743 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T07:21:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:45 smithi029 ceph-mon[30983]: pgmap v720: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 57 op/s 2024-09-21T07:21:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:45 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/2021040837' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:21:46.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:45 smithi029 ceph-mon[30983]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:21:46.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:45 smithi052 ceph-mon[34308]: pgmap v720: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 57 op/s 2024-09-21T07:21:46.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:45 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/2021040837' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:21:46.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:45 smithi052 ceph-mon[34308]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:21:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 -- 172.21.15.29:0/3421651994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7081094b0 msgr2=0x7fe7081098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/3421651994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7081094b0 0x7fe7081098c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009900 tx=0x7fe6f802a410 comp rx=0 tx=0).stop 2024-09-21T07:21:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 -- 172.21.15.29:0/3421651994 shutdown_connections 2024-09-21T07:21:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/3421651994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe708109e00 0x7fe708110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/3421651994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7081094b0 0x7fe7081098c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/3421651994 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe708103bc0 0x7fe708103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 -- 172.21.15.29:0/3421651994 >> 172.21.15.29:0/3421651994 conn(0x7fe70807b910 msgr2=0x7fe70807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 -- 172.21.15.29:0/3421651994 shutdown_connections 2024-09-21T07:21:46.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 -- 172.21.15.29:0/3421651994 wait complete. 2024-09-21T07:21:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 Processor -- start 2024-09-21T07:21:46.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.245+0000 7fe70ed8f640 1 -- start start 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70ed8f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe708103bc0 0x7fe70819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70ed8f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7081094b0 0x7fe70819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70ed8f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe708109e00 0x7fe70819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70ed8f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe708113ac0 con 0x7fe708109e00 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70ed8f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe708113940 con 0x7fe7081094b0 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70ed8f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe708113c40 con 0x7fe708103bc0 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe708109e00 0x7fe70819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe708109e00 0x7fe70819fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46552/0 (socket says 172.21.15.29:46552) 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 -- 172.21.15.29:0/737073547 learned_addr learned my addr 172.21.15.29:0/737073547 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe6fffff640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7081094b0 0x7fe70819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70cb2b640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe708103bc0 0x7fe70819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 -- 172.21.15.29:0/737073547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe708103bc0 msgr2=0x7fe70819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe708103bc0 0x7fe70819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 -- 172.21.15.29:0/737073547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7081094b0 msgr2=0x7fe70819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7081094b0 0x7fe70819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 -- 172.21.15.29:0/737073547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081a0340 con 0x7fe708109e00 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe6fffff640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7081094b0 0x7fe70819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.246+0000 7fe70d32c640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe708109e00 0x7fe70819fcd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe70000eb10 tx=0x7fe70000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.247+0000 7fe6fdffb640 1 -- 172.21.15.29:0/737073547 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700004b20 con 0x7fe708109e00 2024-09-21T07:21:46.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.247+0000 7fe6fdffb640 1 -- 172.21.15.29:0/737073547 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe700004cc0 con 0x7fe708109e00 2024-09-21T07:21:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.247+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7081a0630 con 0x7fe708109e00 2024-09-21T07:21:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.247+0000 7fe6fdffb640 1 -- 172.21.15.29:0/737073547 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700010670 con 0x7fe708109e00 2024-09-21T07:21:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.247+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7081a6e50 con 0x7fe708109e00 2024-09-21T07:21:46.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.248+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe708103fd0 con 0x7fe708109e00 2024-09-21T07:21:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.249+0000 7fe6fdffb640 1 -- 172.21.15.29:0/737073547 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe700005020 con 0x7fe708109e00 2024-09-21T07:21:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.250+0000 7fe6fdffb640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe6f00b65c0 0x7fe6f00b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:21:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.250+0000 7fe70cb2b640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe6f00b65c0 0x7fe6f00b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:21:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.250+0000 7fe6fdffb640 1 -- 172.21.15.29:0/737073547 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8087+0+0 (secure 0 0 0) 0x7fe7000e78c0 con 0x7fe708109e00 2024-09-21T07:21:46.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.251+0000 7fe70cb2b640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe6f00b65c0 0x7fe6f00b8ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe70400ba40 tx=0x7fe704005cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:21:46.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.255+0000 7fe6fdffb640 1 -- 172.21.15.29:0/737073547 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7000ae230 con 0x7fe708109e00 2024-09-21T07:21:46.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:45 smithi066 ceph-mon[34793]: pgmap v720: 97 pgs: 97 active+clean; 8.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.8 KiB/s wr, 57 op/s 2024-09-21T07:21:46.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:45 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/2021040837' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:21:46.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:45 smithi066 ceph-mon[34793]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T07:21:46.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.447+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe70810bbf0 con 0x7fe708109e00 2024-09-21T07:21:46.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.865+0000 7fe6fdffb640 1 -- 172.21.15.29:0/737073547 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7fe7000b2610 con 0x7fe708109e00 2024-09-21T07:21:46.867 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-09-21T07:21:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe6f00b65c0 msgr2=0x7fe6f00b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe6f00b65c0 0x7fe6f00b8ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe70400ba40 tx=0x7fe704005cc0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe708109e00 msgr2=0x7fe70819fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe708109e00 0x7fe70819fcd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe70000eb10 tx=0x7fe70000c2d0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 shutdown_connections 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:6800/4201921978,v1:172.21.15.29:6801/4201921978] conn(0x7fe6f00b65c0 0x7fe6f00b8ad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe708109e00 0x7fe70819fcd0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7081094b0 0x7fe70819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 --2- 172.21.15.29:0/737073547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe708103bc0 0x7fe70819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.869+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 >> 172.21.15.29:0/737073547 conn(0x7fe70807b910 msgr2=0x7fe7081075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:21:46.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.870+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 shutdown_connections 2024-09-21T07:21:46.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-21T07:21:46.871+0000 7fe70ed8f640 1 -- 172.21.15.29:0/737073547 wait complete. 2024-09-21T07:21:47.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:46 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/737073547' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:21:47.243 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:46 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/737073547' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:21:47.351 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:46 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/737073547' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T07:21:47.644 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:21:47.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:21:47.705 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:21:47.735 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T07:21:47.735 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:21:47.751 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:21:47.765 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T07:21:47.791 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T07:21:47.791 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T07:21:47.791 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a 2024-09-21T07:21:47.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:47 smithi029 systemd[1]: Stopping Ceph mon.a for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:21:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:47 smithi052 ceph-mon[34308]: pgmap v722: 65 pgs: 65 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:21:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:47 smithi052 ceph-mon[34308]: from='client.? 172.21.15.29:0/737073547' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:21:47.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:47 smithi052 ceph-mon[34308]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:21:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:47 smithi066 ceph-mon[34793]: pgmap v722: 65 pgs: 65 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:21:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:47 smithi066 ceph-mon[34793]: from='client.? 172.21.15.29:0/737073547' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:21:48.101 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:47 smithi066 ceph-mon[34793]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:21:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:47 smithi029 ceph-mon[30983]: pgmap v722: 65 pgs: 65 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T07:21:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:47 smithi029 ceph-mon[30983]: from='client.? 172.21.15.29:0/737073547' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T07:21:48.121 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:47 smithi029 ceph-mon[30983]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T07:21:48.486 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T07:21:48.156+0000 7fb7dd1ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:21:48.486 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T07:21:48.156+0000 7fb7dd1ab640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T07:21:48.486 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:48 smithi029 podman[85258]: 2024-09-21 07:21:48.207608235 +0000 UTC m=+0.222471766 container died c2727873ade09cc7f44c909cecdb4bbe280da7a48377ac255814ff5d3b7506b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:21:48.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:48 smithi029 podman[85258]: 2024-09-21 07:21:48.635552333 +0000 UTC m=+0.650415850 container cleanup c2727873ade09cc7f44c909cecdb4bbe280da7a48377ac255814ff5d3b7506b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:21:48.871 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:48 smithi029 bash[85258]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a 2024-09-21T07:21:49.247 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 21 07:21:48 smithi029 podman[85271]: 2024-09-21 07:21:48.896676066 +0000 UTC m=+0.685228138 container remove c2727873ade09cc7f44c909cecdb4bbe280da7a48377ac255814ff5d3b7506b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:21:49.270 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T07:21:49.310 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:21:49.310 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T07:21:49.310 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T07:21:49.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.b 2024-09-21T07:21:49.658 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:49 smithi052 systemd[1]: Stopping Ceph mon.b for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:21:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-b[34304]: 2024-09-21T07:21:49.655+0000 7f5cf0acd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:21:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-b[34304]: 2024-09-21T07:21:49.655+0000 7f5cf0acd640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T07:21:49.993 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:49 smithi052 podman[65682]: 2024-09-21 07:21:49.687142794 +0000 UTC m=+0.151806149 container died d9e3857f419cb51a37b4bd5e8ff18ec57bd3b7873f41ad863b3d89d423cb50ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:21:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:50 smithi052 podman[65682]: 2024-09-21 07:21:50.27355614 +0000 UTC m=+0.738219487 container cleanup d9e3857f419cb51a37b4bd5e8ff18ec57bd3b7873f41ad863b3d89d423cb50ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T07:21:50.493 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:50 smithi052 bash[65682]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-b 2024-09-21T07:21:50.852 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T07:21:50.876 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:50 smithi052 podman[65694]: 2024-09-21 07:21:50.625107279 +0000 UTC m=+0.936264006 container remove d9e3857f419cb51a37b4bd5e8ff18ec57bd3b7873f41ad863b3d89d423cb50ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T07:21:50.876 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:50 smithi052 systemd[1]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T07:21:50.876 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:50 smithi052 systemd[1]: Stopped Ceph mon.b for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:21:50.876 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 21 07:21:50 smithi052 systemd[1]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.b.service: Consumed 12.598s CPU time. 2024-09-21T07:21:50.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:21:50.903 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T07:21:50.903 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T07:21:50.903 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.c 2024-09-21T07:21:51.311 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:50 smithi066 systemd[1]: Stopping Ceph mon.c for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:21:51.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c[34789]: 2024-09-21T07:21:51.308+0000 7fb7a33d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:21:51.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c[34789]: 2024-09-21T07:21:51.308+0000 7fb7a33d1640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T07:21:51.601 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:51 smithi066 podman[68286]: 2024-09-21 07:21:51.340213449 +0000 UTC m=+0.242398773 container died ab75bd0e71fc1484b77a913ce290cc2c9834493810e2ac9dff16a0875dc3230a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:21:52.019 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:51 smithi066 podman[68286]: 2024-09-21 07:21:51.733565347 +0000 UTC m=+0.635750670 container cleanup ab75bd0e71fc1484b77a913ce290cc2c9834493810e2ac9dff16a0875dc3230a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:21:52.019 INFO:journalctl@ceph.mon.c.smithi066.stdout:Sep 21 07:21:51 smithi066 bash[68286]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mon-c 2024-09-21T07:21:52.150 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T07:21:52.198 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:21:52.198 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T07:21:52.198 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T07:21:52.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x 2024-09-21T07:21:52.487 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:52 smithi029 systemd[1]: Stopping Ceph mgr.x for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:21:52.871 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:52 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T07:21:52.485+0000 7f3510b8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:21:52.871 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:52 smithi029 podman[85377]: 2024-09-21 07:21:52.517174353 +0000 UTC m=+0.130206947 container died f32a34e381bd36e2af8dfa114bca8170e772ab39002a28a66360add084e61ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T07:21:53.371 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:53 smithi029 podman[85377]: 2024-09-21 07:21:53.046576978 +0000 UTC m=+0.659609550 container cleanup f32a34e381bd36e2af8dfa114bca8170e772ab39002a28a66360add084e61ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T07:21:53.371 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:53 smithi029 bash[85377]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x 2024-09-21T07:21:53.644 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T07:21:53.667 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:53 smithi029 podman[85389]: 2024-09-21 07:21:53.410650507 +0000 UTC m=+0.886787608 container remove f32a34e381bd36e2af8dfa114bca8170e772ab39002a28a66360add084e61ff3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:21:53.667 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:53 smithi029 systemd[1]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x.service: Deactivated successfully. 2024-09-21T07:21:53.667 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:53 smithi029 systemd[1]: Stopped Ceph mgr.x for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:21:53.667 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 21 07:21:53 smithi029 systemd[1]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.x.service: Consumed 49.597s CPU time. 2024-09-21T07:21:53.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:21:53.682 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T07:21:53.682 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T07:21:53.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.y 2024-09-21T07:21:53.993 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:21:53 smithi052 systemd[1]: Stopping Ceph mgr.y for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:21:54.422 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:21:54 smithi052 podman[65806]: 2024-09-21 07:21:54.02455193 +0000 UTC m=+0.147427361 container died 3ba520efe0b15c5f984dd66797b7d91e5852ec9c0034279458598364151027bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T07:21:54.739 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:21:54 smithi052 podman[65806]: 2024-09-21 07:21:54.503684293 +0000 UTC m=+0.626559757 container cleanup 3ba520efe0b15c5f984dd66797b7d91e5852ec9c0034279458598364151027bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-y, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T07:21:54.739 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 21 07:21:54 smithi052 bash[65806]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-y 2024-09-21T07:21:54.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T07:21:54.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:21:54.915 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T07:21:54.915 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T07:21:54.915 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.z 2024-09-21T07:21:55.351 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:21:54 smithi066 systemd[1]: Stopping Ceph mgr.z for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:21:55.766 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:21:55 smithi066 podman[68409]: 2024-09-21 07:21:55.375806753 +0000 UTC m=+0.261264486 container died 8e9c418118ecad116f6f78584cc6f7ba20b998ec95f47b37a83e3862744a8ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T07:21:56.099 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:21:55 smithi066 podman[68409]: 2024-09-21 07:21:55.838689385 +0000 UTC m=+0.724147117 container cleanup 8e9c418118ecad116f6f78584cc6f7ba20b998ec95f47b37a83e3862744a8ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T07:21:56.099 INFO:journalctl@ceph.mgr.z.smithi066.stdout:Sep 21 07:21:55 smithi066 bash[68409]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mgr-z 2024-09-21T07:21:56.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T07:21:56.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:21:56.302 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T07:21:56.302 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T07:21:56.302 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.0 2024-09-21T07:21:56.621 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:21:56 smithi029 systemd[1]: Stopping Ceph osd.0 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:21:57.121 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:21:56 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0[44430]: 2024-09-21T07:21:56.630+0000 7f2aa3d1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:21:57.121 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:21:56 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0[44430]: 2024-09-21T07:21:56.630+0000 7f2aa3d1b640 -1 osd.0 78 *** Got signal Terminated *** 2024-09-21T07:21:57.121 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:21:56 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0[44430]: 2024-09-21T07:21:56.630+0000 7f2aa3d1b640 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:02.361 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:02 smithi029 podman[85497]: 2024-09-21 07:22:02.072701864 +0000 UTC m=+5.566636954 container died 3ee723cdf9383db354ff52be5cea5f6ae4fef71fb20eac1b2abedb723a7d5b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T07:22:02.621 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:02 smithi029 podman[85497]: 2024-09-21 07:22:02.468931959 +0000 UTC m=+5.962867041 container cleanup 3ee723cdf9383db354ff52be5cea5f6ae4fef71fb20eac1b2abedb723a7d5b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T07:22:02.621 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:02 smithi029 bash[85497]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0 2024-09-21T07:22:03.121 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:02 smithi029 podman[85514]: 2024-09-21 07:22:02.780152525 +0000 UTC m=+0.700894009 container remove 3ee723cdf9383db354ff52be5cea5f6ae4fef71fb20eac1b2abedb723a7d5b3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T07:22:03.473 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:03 smithi029 podman[85603]: 2024-09-21 07:22:03.05026283 +0000 UTC m=+0.016542441 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:03.473 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:03 smithi029 podman[85603]: 2024-09-21 07:22:03.174181405 +0000 UTC m=+0.140461002 container create d0090c880b88ce7e16f1228fba71e262aedfb8e5be8224b5dcc2fe68985034c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:22:03.871 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:03 smithi029 podman[85603]: 2024-09-21 07:22:03.472117027 +0000 UTC m=+0.438396636 container init d0090c880b88ce7e16f1228fba71e262aedfb8e5be8224b5dcc2fe68985034c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T07:22:03.871 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:03 smithi029 podman[85603]: 2024-09-21 07:22:03.476186704 +0000 UTC m=+0.442466306 container start d0090c880b88ce7e16f1228fba71e262aedfb8e5be8224b5dcc2fe68985034c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T07:22:03.872 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:03 smithi029 podman[85603]: 2024-09-21 07:22:03.563678961 +0000 UTC m=+0.529958567 container attach d0090c880b88ce7e16f1228fba71e262aedfb8e5be8224b5dcc2fe68985034c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:22:03.872 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 21 07:22:03 smithi029 podman[85603]: 2024-09-21 07:22:03.666374929 +0000 UTC m=+0.632654538 container died d0090c880b88ce7e16f1228fba71e262aedfb8e5be8224b5dcc2fe68985034c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:22:04.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T07:22:04.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:22:04.360 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T07:22:04.360 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T07:22:04.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.1 2024-09-21T07:22:04.659 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:04 smithi052 systemd[1]: Stopping Ceph osd.1 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:22:04.993 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1[38275]: 2024-09-21T07:22:04.656+0000 7f6eecdf9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:22:04.993 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1[38275]: 2024-09-21T07:22:04.656+0000 7f6eecdf9640 -1 osd.1 78 *** Got signal Terminated *** 2024-09-21T07:22:04.993 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1[38275]: 2024-09-21T07:22:04.656+0000 7f6eecdf9640 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:10.493 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:10 smithi052 podman[65933]: 2024-09-21 07:22:10.084794797 +0000 UTC m=+5.535715414 container died 00d191ccd178a95c47d4fe9c2597a0e20731f813a5c341fc4938e50b3ce416a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T07:22:10.818 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:10 smithi052 podman[65933]: 2024-09-21 07:22:10.574709921 +0000 UTC m=+6.025630526 container cleanup 00d191ccd178a95c47d4fe9c2597a0e20731f813a5c341fc4938e50b3ce416a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-21T07:22:10.819 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:10 smithi052 bash[65933]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1 2024-09-21T07:22:11.144 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:10 smithi052 podman[65950]: 2024-09-21 07:22:10.817569474 +0000 UTC m=+0.733521990 container remove 00d191ccd178a95c47d4fe9c2597a0e20731f813a5c341fc4938e50b3ce416a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T07:22:11.405 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:11 smithi052 podman[66040]: 2024-09-21 07:22:11.143327085 +0000 UTC m=+0.105457922 container create 056a9632b2d095ad5fc303e199704b885cfe395d14f6a2708736d39858bc3c3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:22:11.405 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:11 smithi052 podman[66040]: 2024-09-21 07:22:11.053181316 +0000 UTC m=+0.015312164 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:11.405 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:11 smithi052 podman[66040]: 2024-09-21 07:22:11.404243809 +0000 UTC m=+0.366374649 container init 056a9632b2d095ad5fc303e199704b885cfe395d14f6a2708736d39858bc3c3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:11.743 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:11 smithi052 podman[66040]: 2024-09-21 07:22:11.408001312 +0000 UTC m=+0.370132153 container start 056a9632b2d095ad5fc303e199704b885cfe395d14f6a2708736d39858bc3c3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:11.743 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:11 smithi052 podman[66040]: 2024-09-21 07:22:11.537768989 +0000 UTC m=+0.499899836 container attach 056a9632b2d095ad5fc303e199704b885cfe395d14f6a2708736d39858bc3c3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T07:22:11.744 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 21 07:22:11 smithi052 podman[66040]: 2024-09-21 07:22:11.601832918 +0000 UTC m=+0.563963755 container died 056a9632b2d095ad5fc303e199704b885cfe395d14f6a2708736d39858bc3c3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:22:12.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T07:22:12.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:22:12.398 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T07:22:12.399 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T07:22:12.399 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.2 2024-09-21T07:22:12.819 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:12 smithi066 systemd[1]: Stopping Ceph osd.2 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:22:13.091 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2[39210]: 2024-09-21T07:22:12.816+0000 7f7d13bc7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:22:13.091 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2[39210]: 2024-09-21T07:22:12.816+0000 7f7d13bc7640 -1 osd.2 78 *** Got signal Terminated *** 2024-09-21T07:22:13.091 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2[39210]: 2024-09-21T07:22:12.816+0000 7f7d13bc7640 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:18.687 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:18 smithi066 podman[68533]: 2024-09-21 07:22:18.39960185 +0000 UTC m=+5.800905518 container died 30103e0bd497ecb3ae842b63a314734696a41f22e60b361e57732fffcd6c1e12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T07:22:19.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:18 smithi066 podman[68533]: 2024-09-21 07:22:18.784084476 +0000 UTC m=+6.185388127 container cleanup 30103e0bd497ecb3ae842b63a314734696a41f22e60b361e57732fffcd6c1e12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T07:22:19.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:18 smithi066 bash[68533]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2 2024-09-21T07:22:19.571 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:19 smithi066 podman[68560]: 2024-09-21 07:22:19.219135578 +0000 UTC m=+0.814401404 container remove 30103e0bd497ecb3ae842b63a314734696a41f22e60b361e57732fffcd6c1e12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:22:19.823 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:19 smithi066 podman[68651]: 2024-09-21 07:22:19.47308695 +0000 UTC m=+0.016438494 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:19.823 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:19 smithi066 podman[68651]: 2024-09-21 07:22:19.603249591 +0000 UTC m=+0.146601126 container create 571c0cc368a38faff1fd03d6310eb166fafd62dd61c9359e941c501ac445c35c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:22:20.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:19 smithi066 podman[68651]: 2024-09-21 07:22:19.822424931 +0000 UTC m=+0.365776475 container init 571c0cc368a38faff1fd03d6310eb166fafd62dd61c9359e941c501ac445c35c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:20.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:19 smithi066 podman[68651]: 2024-09-21 07:22:19.826147271 +0000 UTC m=+0.369498805 container start 571c0cc368a38faff1fd03d6310eb166fafd62dd61c9359e941c501ac445c35c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T07:22:20.101 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:19 smithi066 podman[68651]: 2024-09-21 07:22:19.922236515 +0000 UTC m=+0.465588056 container attach 571c0cc368a38faff1fd03d6310eb166fafd62dd61c9359e941c501ac445c35c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:22:20.102 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 21 07:22:20 smithi066 podman[68651]: 2024-09-21 07:22:20.022132331 +0000 UTC m=+0.565483866 container died 571c0cc368a38faff1fd03d6310eb166fafd62dd61c9359e941c501ac445c35c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T07:22:20.741 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T07:22:20.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:22:20.789 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T07:22:20.789 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T07:22:20.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.3 2024-09-21T07:22:21.121 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:20 smithi029 systemd[1]: Stopping Ceph osd.3 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:22:21.621 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:21 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3[50694]: 2024-09-21T07:22:21.118+0000 7f887784f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:22:21.621 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:21 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3[50694]: 2024-09-21T07:22:21.118+0000 7f887784f640 -1 osd.3 78 *** Got signal Terminated *** 2024-09-21T07:22:21.621 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:21 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3[50694]: 2024-09-21T07:22:21.118+0000 7f887784f640 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:23.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:22.764+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:23.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:23.345+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:23.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:23 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:23.267+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:24.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:23.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:24.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:23.681+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:24.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:24 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:24.348+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:24.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:24 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:24.251+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:25.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:24 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:24.756+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:25.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:24 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:24.644+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:25.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:25.332+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:25.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:25 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:25.276+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:26.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:25.791+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:26.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:25.667+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:26.294 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:25 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3[50694]: 2024-09-21T07:22:25.972+0000 7f8873e3a640 -1 osd.3 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:00.093205+0000 front 2024-09-21T07:22:00.093161+0000 (oldest deadline 2024-09-21T07:22:25.393260+0000) 2024-09-21T07:22:26.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:26.348+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:26.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:26 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:26.292+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:26.621 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:26 smithi029 podman[85716]: 2024-09-21 07:22:26.525605437 +0000 UTC m=+5.530736273 container died e92bce3c5135658f25a8875e15d3ef575e5b6c06b10362f598037335aeed5671 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-21T07:22:27.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:26.797+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:27.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:26.702+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:27.121 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:26 smithi029 podman[85716]: 2024-09-21 07:22:26.940319362 +0000 UTC m=+5.945450198 container cleanup e92bce3c5135658f25a8875e15d3ef575e5b6c06b10362f598037335aeed5671 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T07:22:27.122 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:26 smithi029 bash[85716]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3 2024-09-21T07:22:27.122 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:27 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:27.018+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:27.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:27.339+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:27.616 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:27 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:27.334+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:27.616 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:27 smithi029 podman[85732]: 2024-09-21 07:22:27.184810397 +0000 UTC m=+0.657637186 container remove e92bce3c5135658f25a8875e15d3ef575e5b6c06b10362f598037335aeed5671 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T07:22:27.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:27 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:27.394+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:27.868 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:27 smithi029 podman[85822]: 2024-09-21 07:22:27.51829334 +0000 UTC m=+0.016389816 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:27.868 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:27 smithi029 podman[85822]: 2024-09-21 07:22:27.638060502 +0000 UTC m=+0.136157039 container create 16017e6a88b7fbc4eb343e0d583295e43cb2c9a4f9a8304ca33e979b2e9d5138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:22:28.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:27.809+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:28.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:27.659+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:28.121 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:28 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:28.039+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:28.121 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:27 smithi029 podman[85822]: 2024-09-21 07:22:27.866857973 +0000 UTC m=+0.364954453 container init 16017e6a88b7fbc4eb343e0d583295e43cb2c9a4f9a8304ca33e979b2e9d5138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T07:22:28.121 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:27 smithi029 podman[85822]: 2024-09-21 07:22:27.870581948 +0000 UTC m=+0.368678424 container start 16017e6a88b7fbc4eb343e0d583295e43cb2c9a4f9a8304ca33e979b2e9d5138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:22:28.121 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:27 smithi029 podman[85822]: 2024-09-21 07:22:27.959121603 +0000 UTC m=+0.457218099 container attach 16017e6a88b7fbc4eb343e0d583295e43cb2c9a4f9a8304ca33e979b2e9d5138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-21T07:22:28.122 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 21 07:22:28 smithi029 podman[85822]: 2024-09-21 07:22:28.070117609 +0000 UTC m=+0.568214085 container died 16017e6a88b7fbc4eb343e0d583295e43cb2c9a4f9a8304ca33e979b2e9d5138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T07:22:28.575 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:28 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:28.294+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:28.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:28.329+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:28.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T07:22:28.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:28 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:28.413+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:28.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:22:28.770 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T07:22:28.770 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T07:22:28.770 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.4 2024-09-21T07:22:29.087 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:28 smithi052 systemd[1]: Stopping Ceph osd.4 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:22:29.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:28.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:29.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:28.643+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:29.367 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:29 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:29.275+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:29.367 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:29 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:29.041+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:29.459 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:29 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4[44686]: 2024-09-21T07:22:29.085+0000 7f786964b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:22:29.459 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:29 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4[44686]: 2024-09-21T07:22:29.085+0000 7f786964b640 -1 osd.4 78 *** Got signal Terminated *** 2024-09-21T07:22:29.459 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:29 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4[44686]: 2024-09-21T07:22:29.085+0000 7f786964b640 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:29.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:29.292+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:29.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:29 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:29.457+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:30.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:29.637+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:30.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:29.775+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:30.283 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:30 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:30.028+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:30.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:30 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:30.245+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:30.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:30 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:30.281+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:30.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:30 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:30.422+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:31.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:30 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:30.682+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:31.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:30 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:30.823+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:31.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:31 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:31.051+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:31.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:31 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:31.280+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:31.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:31 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:31.280+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:31.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:31 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:31.285+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:31.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:31 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:31.426+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:32.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:31 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:31.726+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:32.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:31 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:31.864+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:32.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:31 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:31.864+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:32.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:32.067+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:32.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:32.067+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:32.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:32.245+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:32.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:32.245+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:32.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:32 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:32.273+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:32.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:32 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:32.411+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:32.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:32 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:32.384+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:33.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:32 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:32.748+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:33.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:32 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:32.864+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:33.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:32 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:32.864+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:33.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:33 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:33.034+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:33.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:33 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:33.034+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:33.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:33 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:33.270+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:33.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:33 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:33.270+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:33.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:33 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:33.316+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:33.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:33 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:33.393+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:33.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:33 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:33.420+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:33.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:33 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:33.420+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:34.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:33 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:33.843+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:34.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:33 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:33.843+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:34.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:33 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:33.761+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:34.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:33 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:33.761+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:34.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:34 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:34.067+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:34.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:34 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:34.067+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:34.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:34 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:34.227+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:34.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:34 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:34.227+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:34.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:34 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:34.298+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:34.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:34 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:34.298+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:34.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:34 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:34.379+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:34.743 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:34 smithi052 podman[66154]: 2024-09-21 07:22:34.487021936 +0000 UTC m=+5.513807744 container died 34d4a86b18f89e02c115e914b2d46814078d05608450d1971b66d3948acdabc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T07:22:34.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:34 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:34.448+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:34.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:34 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:34.448+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:35.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:34 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:34.806+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:35.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:34 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:34.806+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:35.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:34 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:34.769+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:35.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:34 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:34.769+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:35.121 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:34 smithi052 podman[66154]: 2024-09-21 07:22:34.877731881 +0000 UTC m=+5.904517689 container cleanup 34d4a86b18f89e02c115e914b2d46814078d05608450d1971b66d3948acdabc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:22:35.122 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:34 smithi052 bash[66154]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4 2024-09-21T07:22:35.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:35 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:35.105+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:35.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:35 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:35.105+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:35.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:35 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:35.188+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:35.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:35 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:35.188+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:35.397 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:35 smithi052 podman[66168]: 2024-09-21 07:22:35.120636044 +0000 UTC m=+0.632801917 container remove 34d4a86b18f89e02c115e914b2d46814078d05608450d1971b66d3948acdabc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T07:22:35.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:35 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:35.348+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:35.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:35 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:35.348+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:35.725 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:35 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:35.396+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:35.726 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:35 smithi052 podman[66257]: 2024-09-21 07:22:35.349169753 +0000 UTC m=+0.015923690 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:35.726 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:35 smithi052 podman[66257]: 2024-09-21 07:22:35.471860104 +0000 UTC m=+0.138614080 container create 4611fac929fd78375658d962eaa66e9517e634b22f2879813c11e689dc792ee0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:22:35.726 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:35 smithi052 podman[66257]: 2024-09-21 07:22:35.724369159 +0000 UTC m=+0.391123096 container init 4611fac929fd78375658d962eaa66e9517e634b22f2879813c11e689dc792ee0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T07:22:35.726 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:35 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:35.420+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:35.726 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:35 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:35.420+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:35.993 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:35 smithi052 podman[66257]: 2024-09-21 07:22:35.727870997 +0000 UTC m=+0.394624937 container start 4611fac929fd78375658d962eaa66e9517e634b22f2879813c11e689dc792ee0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:22:35.993 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:35 smithi052 podman[66257]: 2024-09-21 07:22:35.815925993 +0000 UTC m=+0.482679929 container attach 4611fac929fd78375658d962eaa66e9517e634b22f2879813c11e689dc792ee0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T07:22:35.993 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 21 07:22:35 smithi052 podman[66257]: 2024-09-21 07:22:35.923574734 +0000 UTC m=+0.590328662 container died 4611fac929fd78375658d962eaa66e9517e634b22f2879813c11e689dc792ee0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T07:22:36.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:35 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:35.763+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:36.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:35 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:35.763+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:36.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:35 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:35.816+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:36.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:35 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:35.816+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:36.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:36.074+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:36.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:36.074+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:36.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:36.218+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:36.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:36 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:36.218+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:36.493 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:36 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:36.400+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:36.493 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:36 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:36.446+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:36.493 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:36 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:36.446+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:36.523 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T07:22:36.564 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:22:36.564 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T07:22:36.564 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T07:22:36.564 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.5 2024-09-21T07:22:36.594 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:36.340+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:36.594 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:36.340+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:36.851 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:36.728+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:36.851 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:36.728+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:36.852 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:36 smithi066 systemd[1]: Stopping Ceph osd.5 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:22:36.852 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:36.827+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:36.852 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:36.827+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:37.324 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:36.878+0000 7f452f32f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:22:37.324 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:36.878+0000 7f452f32f640 -1 osd.5 78 *** Got signal Terminated *** 2024-09-21T07:22:37.324 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:36 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:36.878+0000 7f452f32f640 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:37.324 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:37 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:37.321+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:37.324 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:37 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:37.321+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:37.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:37 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:37.071+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:37.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:37 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:37.071+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:37.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:37 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:37.209+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:37.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:37 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:37.209+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:37.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:37 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:37.377+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:37.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:37 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:37.422+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:37.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:37 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:37.422+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:38.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:37 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:37.710+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:38.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:37 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:37.710+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:38.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:37 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:37.854+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:38.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:37 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:37.854+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:38.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:38 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:38.049+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:38.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:38 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:38.049+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:38.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:38 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:38.182+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:38.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:38 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:38.182+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:38.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:38 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:38.339+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:38.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:38 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:38.339+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:38.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:38 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:38.333+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:38.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:38 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:38.442+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:38.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:38 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:38.442+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:39.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:38 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:38.736+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:39.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:38 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:38.736+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:39.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:38 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:38.820+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:39.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:38 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:38.820+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:39.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:39 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:39.083+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:39.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:39 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:39.083+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:39.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:39 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:39.149+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:39.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:39 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:39.149+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:39.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:39 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:39.149+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:39.738 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:39.386+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:39.738 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:39.386+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:39.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:39 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:39.356+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:39.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:39 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:39.413+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:39.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:39 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:39.413+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:39.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:39 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:39.413+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:40.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:39.788+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:40.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:39.788+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:40.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:39.736+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:40.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:39.736+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:40.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:39 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:39.736+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:40.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:40.047+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:40.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:40.047+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:40.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:40.047+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:40.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:40.193+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:40.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:40.193+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:40.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:40 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:40.193+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:40.720 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:40.369+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:40.721 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:40.369+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:40.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:40.403+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:40.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:40.403+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:40.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:40.422+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:40.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:40.422+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:40.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:40 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:40.422+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:41.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:40.719+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:41.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:40.719+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:41.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:40.719+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:41.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:40.741+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:41.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:40 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:40.741+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:41.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:41 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:41.046+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:41.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:41 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:41.046+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:41.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:41 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:41.046+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:41.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:41 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:41.201+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:41.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:41 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:41.201+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:41.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:41 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:41.201+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:41.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:41.346+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.688301+0000 front 2024-09-21T07:21:57.688408+0000 (oldest deadline 2024-09-21T07:22:22.988254+0000) 2024-09-21T07:22:41.601 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5[45794]: 2024-09-21T07:22:41.346+0000 7f452b91a640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:08.289100+0000 front 2024-09-21T07:22:08.289118+0000 (oldest deadline 2024-09-21T07:22:34.189130+0000) 2024-09-21T07:22:41.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:41 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:41.381+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:41.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:41 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:41.381+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:41.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:41 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:41.402+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:41.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:41 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:41.402+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:41.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:41 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:41.402+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:42.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:41.706+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:42.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:41.706+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:42.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:41.706+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:42.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:41.693+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:42.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:41 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:41.693+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:42.328 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:42.022+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:42.328 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:42.022+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:42.328 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:42.022+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:42.328 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:42.189+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:42.329 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:42.189+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:42.329 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:42.189+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:42.714 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:42 smithi066 podman[68755]: 2024-09-21 07:22:42.451638868 +0000 UTC m=+5.686090069 container died af51b2cd5167010036073cf188006b41781e3dbe0e3c9521ba01f8ff41c42219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T07:22:42.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:42 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:42.356+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:42.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:42 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:42.356+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:42.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:42 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:42.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:42.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:42 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:42.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:42.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:42 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:42.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:43.072 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:42 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:42.729+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:43.072 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:42 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:42.729+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:43.072 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:42 smithi066 podman[68755]: 2024-09-21 07:22:42.811920485 +0000 UTC m=+6.046371676 container cleanup af51b2cd5167010036073cf188006b41781e3dbe0e3c9521ba01f8ff41c42219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T07:22:43.073 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:42 smithi066 bash[68755]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5 2024-09-21T07:22:43.073 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:42 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:42.752+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:43.073 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:42 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:42.752+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:43.073 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:42 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:42.752+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:43.351 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:43 smithi066 podman[68771]: 2024-09-21 07:22:43.071301327 +0000 UTC m=+0.616680477 container remove af51b2cd5167010036073cf188006b41781e3dbe0e3c9521ba01f8ff41c42219 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:43.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:42.991+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:43.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:42.991+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:43.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:42.991+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:43.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:43 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:43.208+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:43.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:43 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:43.208+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:43.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:43 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:43.208+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:43.644 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:43 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:43.370+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:43.644 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:43 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:43.370+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:43.645 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:43 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:43.437+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:43.645 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:43 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:43.437+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:43.645 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:43 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:43.437+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:43.734 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:43 smithi066 podman[68868]: 2024-09-21 07:22:43.341846817 +0000 UTC m=+0.016369567 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:43.734 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:43 smithi066 podman[68868]: 2024-09-21 07:22:43.588986421 +0000 UTC m=+0.263509152 container create 3fab61499c955c621ec185424e464ef31b949d4d2948be84a3ca002a6e48d36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T07:22:44.091 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:43 smithi066 podman[68868]: 2024-09-21 07:22:43.891933077 +0000 UTC m=+0.566455807 container init 3fab61499c955c621ec185424e464ef31b949d4d2948be84a3ca002a6e48d36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:22:44.091 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:43 smithi066 podman[68868]: 2024-09-21 07:22:43.895304169 +0000 UTC m=+0.569826899 container start 3fab61499c955c621ec185424e464ef31b949d4d2948be84a3ca002a6e48d36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T07:22:44.091 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:43 smithi066 podman[68868]: 2024-09-21 07:22:43.966667616 +0000 UTC m=+0.641190366 container attach 3fab61499c955c621ec185424e464ef31b949d4d2948be84a3ca002a6e48d36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:22:44.091 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:43 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:43.731+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:44.091 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:43 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:43.731+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:44.092 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:43 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:43.731+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:44.092 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:43 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:43.753+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:44.092 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:43 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:43.753+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:44.092 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:43 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:43.753+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:44.351 INFO:journalctl@ceph.osd.5.smithi066.stdout:Sep 21 07:22:44 smithi066 podman[68868]: 2024-09-21 07:22:44.089726417 +0000 UTC m=+0.764249183 container died 3fab61499c955c621ec185424e464ef31b949d4d2948be84a3ca002a6e48d36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T07:22:44.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:43 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:43.962+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:44.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:43 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:43.962+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:44.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:43 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:43.962+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:44.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:44 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:44.161+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:44.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:44 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:44.161+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:44.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:44 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:44.161+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:44.657 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:44.363+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:44.658 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:44.363+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:44.658 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:44.480+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:44.658 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:44.480+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:44.658 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:44 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:44.480+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:44.661 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T07:22:44.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:22:44.744 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T07:22:44.744 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T07:22:44.744 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.6 2024-09-21T07:22:45.059 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:44 smithi029 systemd[1]: Stopping Ceph osd.6 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:22:45.060 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:44 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:44.922+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:45.060 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:44 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:44.922+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:45.060 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:44 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:44.922+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:45.060 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:45.057+0000 7f78ed459640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:22:45.060 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:45.057+0000 7f78ed459640 -1 osd.6 78 *** Got signal Terminated *** 2024-09-21T07:22:45.060 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:45.057+0000 7f78ed459640 -1 osd.6 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:45.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:44 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:44.764+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:45.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:44 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:44.764+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:45.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:44 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:44.764+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:45.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:44 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:44.749+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:45.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:44 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:44.749+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:45.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:44 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:44.749+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:45.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:45.176+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:45.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:45.176+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:45.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:45.176+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:45.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:45 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:45.387+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:45.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:45 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:45.387+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:45.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:45 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:45.494+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:45.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:45 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:45.494+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:45.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:45 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:45.494+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:46.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:45 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:45.805+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:46.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:45 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:45.805+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:46.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:45 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:45.805+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:46.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:45 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:45.707+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:46.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:45 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:45.707+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:46.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:45 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:45.707+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:46.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:46.149+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:46.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:46.149+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:46.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:46.149+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:46.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:45.953+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:46.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:45.953+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:46.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:45 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:45.953+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:46.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:46 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:46.385+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:46.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:46 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:46.385+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:46.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:46 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:46.460+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:46.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:46 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:46.460+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:46.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:46 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:46.460+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:47.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:46 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:46.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:47.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:46 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:46.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:47.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:46 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:46.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:47.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:46 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:46.685+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:47.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:46 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:46.685+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:47.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:46 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:46.685+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:47.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:47 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:47.129+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:47.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:47 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:47.129+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:47.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:47 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:47.129+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:47.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:46.991+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:47.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:46.991+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:47.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:46.991+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:47.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:46.991+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.333040+0000 front 2024-09-21T07:22:23.333077+0000 (oldest deadline 2024-09-21T07:22:46.833277+0000) 2024-09-21T07:22:47.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:47 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:47.351+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:47.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:47 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:47.351+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:47.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:47 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:47.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:47.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:47 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:47.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:47.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:47 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:47.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:47.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:47 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:47.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:48.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:47.783+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:48.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:47.783+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:48.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:47.783+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:48.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:47.783+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:48.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:47.709+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:48.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:47.709+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:48.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:47.709+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:48.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:47 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:47.709+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:48.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:48.144+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:48.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:48.144+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:48.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:48.144+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:48.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:48.011+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:48.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:48.011+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:48.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:48.011+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:48.372 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:48 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:48.011+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.333040+0000 front 2024-09-21T07:22:23.333077+0000 (oldest deadline 2024-09-21T07:22:46.833277+0000) 2024-09-21T07:22:48.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:48 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:48.336+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:48.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:48 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:48.336+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:48.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:48 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:48.471+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:48.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:48 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:48.471+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:48.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:48 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:48.471+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:48.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:48 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:48.471+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:49.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:48.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:49.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:48.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:49.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:48.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:49.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:48.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:49.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:48.683+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:49.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:48.683+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:49.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:48.683+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:49.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:48 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:48.683+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:49.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:49.051+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.129297+0000 front 2024-09-21T07:22:01.129330+0000 (oldest deadline 2024-09-21T07:22:26.429463+0000) 2024-09-21T07:22:49.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:49.051+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430233+0000 front 2024-09-21T07:22:06.430177+0000 (oldest deadline 2024-09-21T07:22:31.730113+0000) 2024-09-21T07:22:49.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:49.051+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.131900+0000 front 2024-09-21T07:22:15.131932+0000 (oldest deadline 2024-09-21T07:22:39.832064+0000) 2024-09-21T07:22:49.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6[56978]: 2024-09-21T07:22:49.051+0000 7f78e5a3c640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.333040+0000 front 2024-09-21T07:22:23.333077+0000 (oldest deadline 2024-09-21T07:22:46.833277+0000) 2024-09-21T07:22:49.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:49.163+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:49.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:49.163+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:49.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:49.163+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:49.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:49 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:49.163+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:49.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:49.298+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:49.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:49.298+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:49.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:49.298+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:49.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:49.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:49.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:49.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:49.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:49.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:49.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:49 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:49.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:50.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:49.713+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:50.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:49.713+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:50.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:49.713+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:50.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:49.713+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:50.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:49.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:50.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:49.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:50.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:49.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:50.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:49 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:49.739+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:50.436 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:50 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:50.122+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:50.436 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:50 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:50.122+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:50.436 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:50 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:50.122+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:50.437 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:50 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:50.122+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:50.720 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:50 smithi029 podman[85936]: 2024-09-21 07:22:50.43526567 +0000 UTC m=+5.491146314 container died 26d7005958e453f00456450d802a89a0118f2089549f5ebc6786dbaaa15499a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:50.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:50 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:50.345+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:50.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:50 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:50.345+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:50.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:50 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:50.345+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:50.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:50 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:50.499+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:50.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:50 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:50.499+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:50.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:50 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:50.499+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:50.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:50 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:50.499+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:51.077 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:50 smithi029 podman[85936]: 2024-09-21 07:22:50.827164254 +0000 UTC m=+5.883044928 container cleanup 26d7005958e453f00456450d802a89a0118f2089549f5ebc6786dbaaa15499a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T07:22:51.077 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:50 smithi029 bash[85936]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6 2024-09-21T07:22:51.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:50.771+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:51.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:50.771+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:51.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:50.771+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:51.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:50.771+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:51.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:50.742+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:51.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:50.742+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:51.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:50.742+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:51.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:50 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:50.742+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:51.371 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:51 smithi029 podman[85951]: 2024-09-21 07:22:51.10633803 +0000 UTC m=+0.673710623 container remove 26d7005958e453f00456450d802a89a0118f2089549f5ebc6786dbaaa15499a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:51.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:51 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:51.075+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:51.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:51 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:51.075+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:51.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:51 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:51.075+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:51.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:51 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:51.075+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:51.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:51.365+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:51.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:51.365+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:51.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:51.365+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:51.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:51.466+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:51.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:51.466+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:51.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:51.466+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:51.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:51.466+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:51.754 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:51 smithi029 podman[86041]: 2024-09-21 07:22:51.361397139 +0000 UTC m=+0.015957371 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:51.754 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:51 smithi029 podman[86041]: 2024-09-21 07:22:51.474657812 +0000 UTC m=+0.129218075 container create bacade64adef49e9bb21b200c8928e18a2236720fb563d715db140634244fecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T07:22:52.052 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:51 smithi029 podman[86041]: 2024-09-21 07:22:51.753607697 +0000 UTC m=+0.408167916 container init bacade64adef49e9bb21b200c8928e18a2236720fb563d715db140634244fecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:52.052 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:51 smithi029 podman[86041]: 2024-09-21 07:22:51.757478724 +0000 UTC m=+0.412038942 container start bacade64adef49e9bb21b200c8928e18a2236720fb563d715db140634244fecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:22:52.052 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:51 smithi029 podman[86041]: 2024-09-21 07:22:51.845714282 +0000 UTC m=+0.500274499 container attach bacade64adef49e9bb21b200c8928e18a2236720fb563d715db140634244fecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:22:52.052 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 21 07:22:51 smithi029 podman[86041]: 2024-09-21 07:22:51.952372236 +0000 UTC m=+0.606932461 container died bacade64adef49e9bb21b200c8928e18a2236720fb563d715db140634244fecc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T07:22:52.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:51.770+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:52.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:51.770+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:52.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:51.770+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:52.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:51.770+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:52.101 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:51.756+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:52.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:51.756+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:52.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:51.756+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:52.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:51 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:51.757+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:52.312 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:52 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:52.050+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:52.312 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:52 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:52.050+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:52.312 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:52 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:52.050+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:52.312 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:52 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:52.050+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:52.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T07:22:52.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:22:52.665 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T07:22:52.665 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T07:22:52.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.7 2024-09-21T07:22:52.694 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:52.387+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:52.695 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:52.387+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:52.695 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:52.387+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:52.695 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:52.479+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:52.695 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:52.479+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:52.695 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:52.479+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:52.695 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:52.479+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:52.974 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:52 smithi052 systemd[1]: Stopping Ceph osd.7 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:22:53.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:52.809+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:53.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:52.809+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:53.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:52.809+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:53.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:52.809+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:53.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:52.734+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:53.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:52.734+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:53.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:52.734+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:53.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:52 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:52.734+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:53.243 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:52.972+0000 7f558a937640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:22:53.243 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:52.972+0000 7f558a937640 -1 osd.7 78 *** Got signal Terminated *** 2024-09-21T07:22:53.243 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:52 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:52.972+0000 7f558a937640 -1 osd.7 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:22:53.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:53 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:53.003+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:53.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:53 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:53.003+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:53.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:53 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:53.003+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:53.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:53 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:53.003+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:53.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:53 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:53.423+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:53.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:53 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:53.423+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:53.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:53 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:53.423+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:53.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:53 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:53.491+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:53.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:53 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:53.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:53.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:53 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:53.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:53.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:53 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:53.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:54.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:53.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:54.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:53.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:54.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:53.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:54.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:53.767+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:54.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:53.771+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:54.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:53.772+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:54.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:53.772+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:54.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:53 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:53.772+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:54.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:54 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:54.009+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:54.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:54 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:54.009+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:54.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:54 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:54.009+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:54.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:54 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:54.009+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:54.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:54.392+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:54.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:54.392+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:54.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:54.392+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:54.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:54.452+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:54.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:54.452+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:54.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:54.452+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:54.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:54.452+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:55.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:54.799+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:55.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:54.799+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:55.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:54.799+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:55.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:54.799+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:55.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:54.731+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:55.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:54.731+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:55.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:54.731+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:55.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:54 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:54.731+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:55.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:55 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:55.030+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:55.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:55 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:55.030+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:55.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:55 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:55.030+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:55.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:55 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:55.030+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:55.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:55 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:55.347+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:55.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:55 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:55.347+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:55.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:55 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:55.347+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:55.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:55 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:55.428+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:55.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:55 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:55.428+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:55.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:55 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:55.428+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:55.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:55 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:55.428+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:56.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:55.760+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:56.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:55.760+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:56.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:55.760+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:56.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:55.760+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:56.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:55.741+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:56.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:55.741+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:56.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:55.741+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:56.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:55 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:55.741+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:56.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:56 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:56.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:56.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:56 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:56.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:56.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:56 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:56.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:56.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:56 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:56.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:56.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:56 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:56.348+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:56.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:56 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:56.348+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:56.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:56 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:56.348+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:56.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:56 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:56.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:56.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:56 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:56.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:56.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:56 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:56.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:56.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:56 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:56.439+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:57.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:56.766+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:57.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:56.766+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:57.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:56.766+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:57.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:56.766+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:57.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:56.705+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:57.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:56.705+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:57.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:56.705+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:57.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:56.705+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:57.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:56 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:56.705+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:22:57.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:57 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:57.067+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:57.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:57 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:57.067+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:57.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:57 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:57.067+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:57.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:57 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:57.067+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:57.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:57.389+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.593206+0000 front 2024-09-21T07:22:07.593259+0000 (oldest deadline 2024-09-21T07:22:32.293451+0000) 2024-09-21T07:22:57.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:57.389+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:16.895129+0000 front 2024-09-21T07:22:16.894984+0000 (oldest deadline 2024-09-21T07:22:40.394996+0000) 2024-09-21T07:22:57.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7[51012]: 2024-09-21T07:22:57.389+0000 7f5586f22640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.696120+0000 front 2024-09-21T07:22:22.696049+0000 (oldest deadline 2024-09-21T07:22:48.595953+0000) 2024-09-21T07:22:57.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:57.392+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:57.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:57.392+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:57.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:57.392+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:57.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:57.392+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:58.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:57.730+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:58.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:57.730+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:58.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:57.730+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:58.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:57.730+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:58.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:57.674+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:58.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:57.674+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:58.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:57.674+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:58.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:57.674+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:58.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:57 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:57.674+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:22:58.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:58.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:58.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:58.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:58.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:58.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:58.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:58 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:58.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:58.743 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:58 smithi052 podman[66372]: 2024-09-21 07:22:58.442311956 +0000 UTC m=+5.569299754 container died 7b6fa3df11ca41c9945cfd71d274f4a8006aadb572f533dfbcb0d63846dccb17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T07:22:58.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:58 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:58.415+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:58.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:58 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:58.415+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:58.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:58 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:58.415+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:58.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:58 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:58.415+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:58.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:58 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:58.415+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:22:59.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:58.696+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:22:59.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:58.696+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:22:59.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:58.696+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:22:59.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:58.696+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:22:59.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:58.722+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:22:59.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:58.722+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:22:59.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:58.722+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:22:59.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:58.722+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:22:59.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:58 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:58.722+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:22:59.165 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:58 smithi052 podman[66372]: 2024-09-21 07:22:58.905527154 +0000 UTC m=+6.032514951 container cleanup 7b6fa3df11ca41c9945cfd71d274f4a8006aadb572f533dfbcb0d63846dccb17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T07:22:59.166 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:58 smithi052 bash[66372]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7 2024-09-21T07:22:59.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:59 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:59.061+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:22:59.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:59 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:59.061+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:22:59.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:59 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:59.061+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:22:59.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:22:59 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:22:59.061+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:22:59.419 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:59 smithi052 podman[66390]: 2024-09-21 07:22:59.16480944 +0000 UTC m=+0.720999787 container remove 7b6fa3df11ca41c9945cfd71d274f4a8006aadb572f533dfbcb0d63846dccb17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T07:22:59.693 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:59 smithi052 podman[66476]: 2024-09-21 07:22:59.427472725 +0000 UTC m=+0.016245366 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:22:59.693 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:59 smithi052 podman[66476]: 2024-09-21 07:22:59.590880495 +0000 UTC m=+0.179653160 container create b28fc000867f3e5fa373dfa8cec6af7b2156bcfb0145102b78fc624f3baaa4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T07:22:59.694 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:59 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:59.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:22:59.694 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:59 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:59.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:22:59.694 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:59 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:59.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:22:59.694 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:59 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:59.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:22:59.694 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:22:59 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:22:59.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:22:59.993 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:59 smithi052 podman[66476]: 2024-09-21 07:22:59.801560472 +0000 UTC m=+0.390333101 container init b28fc000867f3e5fa373dfa8cec6af7b2156bcfb0145102b78fc624f3baaa4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:22:59.993 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:59 smithi052 podman[66476]: 2024-09-21 07:22:59.805307807 +0000 UTC m=+0.394080420 container start b28fc000867f3e5fa373dfa8cec6af7b2156bcfb0145102b78fc624f3baaa4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T07:22:59.993 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:59 smithi052 podman[66476]: 2024-09-21 07:22:59.88462821 +0000 UTC m=+0.473400829 container attach b28fc000867f3e5fa373dfa8cec6af7b2156bcfb0145102b78fc624f3baaa4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T07:23:00.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:59.737+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:23:00.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:59.737+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:23:00.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:59.737+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:23:00.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:22:59.737+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:23:00.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:59.733+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:00.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:59.733+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:00.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:59.733+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:00.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:59.733+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:00.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:22:59 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:22:59.733+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:00.279 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 21 07:22:59 smithi052 podman[66476]: 2024-09-21 07:22:59.998147038 +0000 UTC m=+0.586919659 container died b28fc000867f3e5fa373dfa8cec6af7b2156bcfb0145102b78fc624f3baaa4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T07:23:00.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:00 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:00.080+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:00.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:00 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:00.080+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:00.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:00 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:00.080+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:00.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:00 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:00.080+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:00.589 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:00 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:00.391+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:00.590 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:00 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:00.391+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:00.590 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:00 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:00.391+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:00.590 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:00 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:00.391+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:00.590 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:00 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:00.391+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:00.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T07:23:00.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:00.697 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T07:23:00.697 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T07:23:00.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.8 2024-09-21T07:23:01.007 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:00.690+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:23:01.007 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:00.690+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:23:01.007 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:00.690+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:23:01.007 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:00.690+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:23:01.007 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:00 smithi066 systemd[1]: Stopping Ceph osd.8 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:01.008 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:00.748+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:01.008 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:00.748+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:01.008 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:00.748+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:01.008 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:00.748+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:01.008 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:00 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:00.748+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:01.351 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:01.005+0000 7f5ef39e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:01.351 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:01.005+0000 7f5ef39e3640 -1 osd.8 78 *** Got signal Terminated *** 2024-09-21T07:23:01.351 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:01.005+0000 7f5ef39e3640 -1 osd.8 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:23:01.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:01 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:01.115+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:01.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:01 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:01.115+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:01.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:01 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:01.115+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:01.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:01 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:01.115+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:01.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:01 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:01.115+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:01.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:01 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:01.427+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:01.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:01 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:01.427+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:01.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:01 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:01.427+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:01.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:01 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:01.427+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:01.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:01 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:01.427+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:02.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:01.641+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:23:02.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:01.641+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:23:02.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:01.641+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:23:02.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:01.641+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:23:02.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:01.783+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:02.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:01.783+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:02.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:01.783+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:02.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:01.783+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:02.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:01 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:01.783+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:02.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:02 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:02.077+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:02.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:02 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:02.077+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:02.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:02 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:02.077+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:02.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:02 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:02.077+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:02.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:02 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:02.077+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:02.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:02 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:02.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:02.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:02 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:02.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:02.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:02 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:02.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:02.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:02 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:02.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:02.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:02 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:02.418+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:03.103 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:02.672+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:02.672+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:02.672+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:02.672+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:02.833+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:02.833+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:02.833+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:02.833+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:03.104 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:02 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:02.833+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:03.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:03 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:03.082+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:03.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:03 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:03.082+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:03.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:03 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:03.082+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:03.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:03 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:03.082+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:03.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:03 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:03.082+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:03.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:03 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:03.082+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:03.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:03 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:03.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:03.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:03 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:03.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:03.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:03 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:03.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:03.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:03 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:03.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:03.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:03 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:03.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:03.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:03 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:03.451+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:04.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:03.628+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:23:04.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:03.628+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:23:04.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:03.628+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:23:04.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:03.628+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:23:04.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:03.628+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:38.896433+0000 front 2024-09-21T07:22:38.896455+0000 (oldest deadline 2024-09-21T07:23:03.596481+0000) 2024-09-21T07:23:04.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:03.830+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:04.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:03.830+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:04.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:03.830+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:04.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:03.830+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:04.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:03.830+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:04.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:03 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:03.830+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:04.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:04 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:04.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:04.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:04 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:04.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:04.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:04 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:04.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:04.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:04 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:04.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:04.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:04 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:04.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:04.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:04 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:04.070+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:04.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:04.488+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:04.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:04.488+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:04.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:04.488+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:04.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:04.488+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:04.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:04.488+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:04.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:04 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:04.488+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:05.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:04.655+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:23:05.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:04.655+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:04.655+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:04.655+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:04.655+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:38.896433+0000 front 2024-09-21T07:22:38.896455+0000 (oldest deadline 2024-09-21T07:23:03.596481+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:04.835+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:04.835+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:04.835+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:04.835+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:04.835+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:05.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:04 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:04.835+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:05.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:05 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:05.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:05.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:05 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:05.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:05.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:05 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:05.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:05.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:05 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:05.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:05.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:05 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:05.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:05.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:05 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:05.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:05.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:05 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:05.467+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:05.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:05 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:05.467+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:05.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:05 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:05.467+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:05.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:05 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:05.467+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:05.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:05 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:05.467+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:05.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:05 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:05.467+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:06.101 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:05.634+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.089758+0000 front 2024-09-21T07:22:01.089813+0000 (oldest deadline 2024-09-21T07:22:22.189882+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:05.634+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.092057+0000 front 2024-09-21T07:22:09.092148+0000 (oldest deadline 2024-09-21T07:22:31.392163+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:05.634+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.093152+0000 front 2024-09-21T07:22:13.093136+0000 (oldest deadline 2024-09-21T07:22:38.993359+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:05.634+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.494797+0000 front 2024-09-21T07:22:22.494754+0000 (oldest deadline 2024-09-21T07:22:47.194660+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8[52408]: 2024-09-21T07:23:05.634+0000 7f5eeffce640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:38.896433+0000 front 2024-09-21T07:22:38.896455+0000 (oldest deadline 2024-09-21T07:23:03.596481+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:05.858+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:05.858+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:05.858+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:05.858+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:05.858+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:06.102 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:05.858+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:06.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:06 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:06.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:06.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:06 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:06.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:06.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:06 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:06.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:06.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:06 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:06.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:06.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:06 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:06.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:06.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:06 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:06.078+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:06.624 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:06 smithi066 podman[68969]: 2024-09-21 07:23:06.368811331 +0000 UTC m=+5.473452732 container died e444e42a5a9d444ad89d39f810e37bad0ca118a4c506c1430e89a5f7721001d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T07:23:06.876 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:06 smithi066 podman[68969]: 2024-09-21 07:23:06.722330392 +0000 UTC m=+5.826971797 container cleanup e444e42a5a9d444ad89d39f810e37bad0ca118a4c506c1430e89a5f7721001d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:23:06.876 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:06 smithi066 bash[68969]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8 2024-09-21T07:23:06.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:06 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:06.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:06.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:06 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:06.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:06.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:06 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:06.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:06.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:06 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:06.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:06.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:06 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:06.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:06.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:06 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:06.492+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:07.351 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:06 smithi066 podman[68988]: 2024-09-21 07:23:06.99012556 +0000 UTC m=+0.619721911 container remove e444e42a5a9d444ad89d39f810e37bad0ca118a4c506c1430e89a5f7721001d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T07:23:07.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:06 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:06.874+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:07.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:06 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:06.874+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:07.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:06 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:06.874+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:07.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:06 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:06.874+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:07.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:06 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:06.874+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:07.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:06 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:06.874+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:07.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:07 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:07.088+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:07.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:07 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:07.088+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:07.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:07 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:07.088+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:07.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:07 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:07.088+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:07.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:07 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:07.088+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:07.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:07 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:07.088+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:07.669 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:07 smithi066 podman[69077]: 2024-09-21 07:23:07.25952574 +0000 UTC m=+0.016042129 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:23:07.669 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:07 smithi066 podman[69077]: 2024-09-21 07:23:07.357318061 +0000 UTC m=+0.113834442 container create 07b814d23e66ae7851e4bb0b03fe70834127af300824221e88f5b039bb1c833a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:23:07.669 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:07 smithi066 podman[69077]: 2024-09-21 07:23:07.584888175 +0000 UTC m=+0.341404566 container init 07b814d23e66ae7851e4bb0b03fe70834127af300824221e88f5b039bb1c833a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:23:07.669 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:07 smithi066 podman[69077]: 2024-09-21 07:23:07.588296174 +0000 UTC m=+0.344812554 container start 07b814d23e66ae7851e4bb0b03fe70834127af300824221e88f5b039bb1c833a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:23:07.669 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:07 smithi066 podman[69077]: 2024-09-21 07:23:07.668022872 +0000 UTC m=+0.424539266 container attach 07b814d23e66ae7851e4bb0b03fe70834127af300824221e88f5b039bb1c833a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T07:23:07.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:07 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:07.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:07.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:07 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:07.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:07.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:07 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:07.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:07.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:07 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:07.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:07.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:07 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:07.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:07.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:07 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:07.450+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:08.073 INFO:journalctl@ceph.osd.8.smithi066.stdout:Sep 21 07:23:07 smithi066 podman[69077]: 2024-09-21 07:23:07.780294916 +0000 UTC m=+0.536811305 container died 07b814d23e66ae7851e4bb0b03fe70834127af300824221e88f5b039bb1c833a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T07:23:08.073 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:07 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:07.884+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:08.073 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:07 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:07.884+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:08.074 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:07 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:07.884+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:08.074 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:07 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:07.884+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:08.074 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:07 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:07.884+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:08.074 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:07 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:07.884+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:08.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.042+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:08.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.042+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:08.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.042+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:08.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.042+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:08.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.042+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:08.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.042+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:08.387 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T07:23:08.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:08.427 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T07:23:08.427 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T07:23:08.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.9 2024-09-21T07:23:08.729 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 systemd[1]: Stopping Ceph osd.9 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:08.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:08 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:08.487+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:08.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:08 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:08.487+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:08.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:08 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:08.487+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:08.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:08 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:08.487+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:08.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:08 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:08.487+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:08.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:08 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:08.487+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:08.900 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:08.897+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:08.900 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:08.897+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:08.900 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:08.897+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:08.900 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:08.897+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:08.900 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:08.897+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:08.900 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:08 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:08.897+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.727+0000 7f10b59f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.727+0000 7f10b59f5640 -1 osd.9 78 *** Got signal Terminated *** 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:08 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:08.727+0000 7f10b59f5640 -1 osd.9 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:09 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:09.066+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:09 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:09.066+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:09 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:09.066+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:09 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:09.066+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:09 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:09.066+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:09.068 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:09 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:09.066+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:09.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:09 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:09.440+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:09.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:09 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:09.440+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:09.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:09 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:09.440+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:09.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:09 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:09.440+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:09.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:09 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:09.440+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:09.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:09 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:09.440+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:10.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:09.933+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:10.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:09.933+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:10.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:09.933+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:10.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:09.933+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:10.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:09.933+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:10.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:09.933+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:10.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:10.036+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:10.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:10.036+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:10.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:10.036+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:10.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:10.036+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:10.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:10.036+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:10.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:10 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:10.036+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:10.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:10 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:10.459+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:10.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:10 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:10.459+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:10.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:10 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:10.459+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:10.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:10 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:10.459+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:10.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:10 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:10.459+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:10.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:10 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:10.459+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:11.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:10 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:10.983+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:11.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:10 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:10.983+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:11.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:10 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:10.983+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:11.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:10 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:10.983+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:11.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:10 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:10.983+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:11.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:10 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:10.983+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:11.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:11 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:11.026+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:11.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:11 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:11.026+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:11.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:11 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:11.026+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:11.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:11 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:11.026+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:11.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:11 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:11.026+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:11.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:11 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:11.026+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:11.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:11 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:11.434+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:11.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:11 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:11.434+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:11.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:11 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:11.434+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:11.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:11 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:11.434+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:11.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:11 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:11.434+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:11.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:11 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:11.434+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:12.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:12.022+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:12.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:12.022+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:12.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:12.022+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:12.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:12.022+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:12.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:12.022+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:12.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:12 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:12.022+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:12.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:12 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:12.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:12.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:12 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:12.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:12.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:12 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:12.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:12.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:12 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:12.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:12.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:12 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:12.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:12.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:12 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:12.054+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:12.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:12 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:12.432+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:12.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:12 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:12.432+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:12.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:12 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:12.432+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:12.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:12 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:12.432+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:12.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:12 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:12.432+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:12.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:12 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:12.432+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:13.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:13 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:13.028+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:13.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:13 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:13.028+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:13.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:13 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:13.028+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:13.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:13 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:13.028+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:13.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:13 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:13.028+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:13.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:13 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:13.028+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:13.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:13 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:13.098+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:58.229467+0000 front 2024-09-21T07:21:58.229152+0000 (oldest deadline 2024-09-21T07:22:22.329283+0000) 2024-09-21T07:23:13.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:13 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:13.098+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:06.430623+0000 front 2024-09-21T07:22:06.430745+0000 (oldest deadline 2024-09-21T07:22:31.130548+0000) 2024-09-21T07:23:13.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:13 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:13.098+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:15.132501+0000 front 2024-09-21T07:22:15.132477+0000 (oldest deadline 2024-09-21T07:22:38.632464+0000) 2024-09-21T07:23:13.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:13 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:13.098+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:23.933479+0000 front 2024-09-21T07:22:23.933398+0000 (oldest deadline 2024-09-21T07:22:48.533932+0000) 2024-09-21T07:23:13.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:13 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:13.098+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:33.135809+0000 front 2024-09-21T07:22:33.135681+0000 (oldest deadline 2024-09-21T07:23:00.136232+0000) 2024-09-21T07:23:13.372 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:13 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9[63645]: 2024-09-21T07:23:13.098+0000 7f10b1fe0640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:41.137840+0000 front 2024-09-21T07:22:41.137924+0000 (oldest deadline 2024-09-21T07:23:02.837707+0000) 2024-09-21T07:23:13.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:13 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:13.407+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:13.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:13 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:13.407+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:13.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:13 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:13.407+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:13.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:13 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:13.407+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:13.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:13 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:13.407+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:13.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:13 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:13.407+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:14.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:14.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:14.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:14.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:14.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:14.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:14.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:14.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:14.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:14.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:14.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:14.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:14.371 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:14 smithi029 podman[86155]: 2024-09-21 07:23:14.08383215 +0000 UTC m=+5.456259669 container died 44e8b1ce0834be69941a5d0af809be5edbc9a038e5d68703898bdb83ee0d957b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T07:23:14.717 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:14 smithi029 podman[86155]: 2024-09-21 07:23:14.470561536 +0000 UTC m=+5.842989038 container cleanup 44e8b1ce0834be69941a5d0af809be5edbc9a038e5d68703898bdb83ee0d957b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T07:23:14.717 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:14 smithi029 bash[86155]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9 2024-09-21T07:23:14.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:14 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:14.362+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:14.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:14 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:14.362+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:14.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:14 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:14.362+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:14.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:14 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:14.362+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:14.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:14 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:14.362+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:14.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:14 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:14.362+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:14.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:14 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:14.362+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:15.042 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:14 smithi029 podman[86170]: 2024-09-21 07:23:14.71619345 +0000 UTC m=+0.634218479 container remove 44e8b1ce0834be69941a5d0af809be5edbc9a038e5d68703898bdb83ee0d957b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:23:15.331 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:15 smithi029 podman[86261]: 2024-09-21 07:23:14.943735113 +0000 UTC m=+0.016081341 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:23:15.331 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:15 smithi029 podman[86261]: 2024-09-21 07:23:15.042654774 +0000 UTC m=+0.115000993 container create 60e8e636faf79d019843a0bdaacd4a520fa2c9d52af4b8f08336fc68c657c796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T07:23:15.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:15 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:15.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:15.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:15 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:15.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:15.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:15 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:15.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:15.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:15 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:15.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:15.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:15 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:15.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:15.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:15 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:15.016+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:15.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:15 smithi029 podman[86261]: 2024-09-21 07:23:15.330431339 +0000 UTC m=+0.402777563 container init 60e8e636faf79d019843a0bdaacd4a520fa2c9d52af4b8f08336fc68c657c796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T07:23:15.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:15 smithi029 podman[86261]: 2024-09-21 07:23:15.333879582 +0000 UTC m=+0.406225799 container start 60e8e636faf79d019843a0bdaacd4a520fa2c9d52af4b8f08336fc68c657c796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T07:23:15.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:15 smithi029 podman[86261]: 2024-09-21 07:23:15.422420089 +0000 UTC m=+0.494766304 container attach 60e8e636faf79d019843a0bdaacd4a520fa2c9d52af4b8f08336fc68c657c796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:23:15.621 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 21 07:23:15 smithi029 podman[86261]: 2024-09-21 07:23:15.527471578 +0000 UTC m=+0.599817810 container died 60e8e636faf79d019843a0bdaacd4a520fa2c9d52af4b8f08336fc68c657c796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:23:15.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:15.376+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:15.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:15.376+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:15.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:15.376+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:15.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:15.376+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:15.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:15.376+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:15.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:15.376+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:15.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:15 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:15.376+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:16.180 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T07:23:16.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:16.225 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T07:23:16.225 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T07:23:16.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.10 2024-09-21T07:23:16.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.014+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:16.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.014+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:16.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.014+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:16.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.014+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:16.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.014+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:16.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.014+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 systemd[1]: Stopping Ceph osd.10 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.341+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.341+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.341+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.341+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.341+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.341+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:16.610 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.341+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:16.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.607+0000 7f7b5f3c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:16.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.607+0000 7f7b5f3c3640 -1 osd.10 78 *** Got signal Terminated *** 2024-09-21T07:23:16.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:16 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:16.607+0000 7f7b5f3c3640 -1 osd.10 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:23:17.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.998+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:17.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.998+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:17.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.998+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:17.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.998+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:17.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.998+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:17.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:16 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:16.998+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:17.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:17.332+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:17.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:17.332+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:17.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:17.332+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:17.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:17.332+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:17.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:17.332+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:17.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:17.332+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:17.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:17 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:17.332+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:18.353 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:18 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:18.048+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:18.354 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:18 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:18.048+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:18.354 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:18 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:18.048+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:18.354 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:18 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:18.048+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:18.354 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:18 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:18.048+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:18.354 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:18 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:18.048+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:18.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:18 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:18.382+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:18.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:18 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:18.382+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:18.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:18 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:18.382+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:18.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:18 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:18.382+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:18.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:18 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:18.382+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:18.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:18 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:18.382+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:18.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:18 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:18.382+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:19.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:19 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:19.037+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:19.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:19 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:19.037+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:19.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:19 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:19.037+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:19.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:19 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:19.037+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:19.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:19 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:19.037+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:19.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:19 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:19.037+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:19.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:19 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:19.037+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:19.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:19 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:19.334+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:19.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:19 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:19.334+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:19.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:19 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:19.334+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:19.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:19 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:19.334+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:19.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:19 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:19.334+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:19.745 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:19 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:19.334+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:19.745 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:19 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:19.334+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:20.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:20 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:20.081+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:20.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:20 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:20.081+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:20.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:20 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:20.081+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:20.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:20 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:20.081+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:20.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:20 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:20.081+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:20.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:20 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:20.081+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:20.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:20 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:20.081+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:20.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:20 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:20.303+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:20.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:20 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:20.303+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:20.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:20 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:20.303+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:20.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:20 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:20.303+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:20.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:20 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:20.303+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:20.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:20 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:20.303+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:20.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:20 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:20.303+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:21.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:21 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:21.053+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:21.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:21 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:21.053+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:21.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:21 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:21.053+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:21.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:21 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:21.053+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:21.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:21 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:21.053+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:21.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:21 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:21.053+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:21.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:21 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:21.053+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:21.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:21 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:21.281+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:22:01.599607+0000 front 2024-09-21T07:22:01.599653+0000 (oldest deadline 2024-09-21T07:22:26.899612+0000) 2024-09-21T07:23:21.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:21 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:21.281+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:07.400617+0000 front 2024-09-21T07:22:07.400699+0000 (oldest deadline 2024-09-21T07:22:33.300687+0000) 2024-09-21T07:23:21.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:21 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:21.281+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:13.801743+0000 front 2024-09-21T07:22:13.801763+0000 (oldest deadline 2024-09-21T07:22:38.501857+0000) 2024-09-21T07:23:21.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:21 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:21.281+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:24.604567+0000 front 2024-09-21T07:22:24.604545+0000 (oldest deadline 2024-09-21T07:22:46.804887+0000) 2024-09-21T07:23:21.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:21 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:21.281+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:29.705826+0000 front 2024-09-21T07:22:29.705859+0000 (oldest deadline 2024-09-21T07:22:57.906440+0000) 2024-09-21T07:23:21.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:21 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:21.281+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:37.907022+0000 front 2024-09-21T07:22:37.907210+0000 (oldest deadline 2024-09-21T07:23:02.606961+0000) 2024-09-21T07:23:21.744 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:21 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10[57217]: 2024-09-21T07:23:21.281+0000 7f7b579a6640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-21T07:22:49.409271+0000 front 2024-09-21T07:22:49.409221+0000 (oldest deadline 2024-09-21T07:23:13.509056+0000) 2024-09-21T07:23:22.317 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:22 smithi052 podman[66591]: 2024-09-21 07:23:22.045724292 +0000 UTC m=+5.616262780 container died 99ef9f5214886aac07cd961cb6a7170b7c34053afed5f6f7468c6949e921627d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T07:23:22.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.012+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:22.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.012+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:22.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.012+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:22.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.012+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:22.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.012+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:22.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.012+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:22.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.012+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:22.668 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:22 smithi052 podman[66591]: 2024-09-21 07:23:22.415987777 +0000 UTC m=+5.986526263 container cleanup 99ef9f5214886aac07cd961cb6a7170b7c34053afed5f6f7468c6949e921627d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T07:23:22.669 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:22 smithi052 bash[66591]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10 2024-09-21T07:23:22.993 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:22 smithi052 podman[66606]: 2024-09-21 07:23:22.667523863 +0000 UTC m=+0.615545719 container remove 99ef9f5214886aac07cd961cb6a7170b7c34053afed5f6f7468c6949e921627d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T07:23:23.297 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:23 smithi052 podman[66695]: 2024-09-21 07:23:22.932156138 +0000 UTC m=+0.015814535 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:23:23.297 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:23 smithi052 podman[66695]: 2024-09-21 07:23:23.03504501 +0000 UTC m=+0.118703440 container create 574a9c2f602ea158b34bef5bd7dc64aae8d32da40f6808ddb6799ca151b15464 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T07:23:23.297 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:23 smithi052 podman[66695]: 2024-09-21 07:23:23.295912874 +0000 UTC m=+0.379571261 container init 574a9c2f602ea158b34bef5bd7dc64aae8d32da40f6808ddb6799ca151b15464 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T07:23:23.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.975+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:23.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.975+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:23.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.975+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:23.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.975+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:23.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.975+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:23.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.975+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:23.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:22 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:22.975+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:23.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:23 smithi052 podman[66695]: 2024-09-21 07:23:23.299206707 +0000 UTC m=+0.382865092 container start 574a9c2f602ea158b34bef5bd7dc64aae8d32da40f6808ddb6799ca151b15464 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T07:23:23.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:23 smithi052 podman[66695]: 2024-09-21 07:23:23.387527001 +0000 UTC m=+0.471185397 container attach 574a9c2f602ea158b34bef5bd7dc64aae8d32da40f6808ddb6799ca151b15464 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T07:23:23.743 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 21 07:23:23 smithi052 podman[66695]: 2024-09-21 07:23:23.488082123 +0000 UTC m=+0.571740521 container died 574a9c2f602ea158b34bef5bd7dc64aae8d32da40f6808ddb6799ca151b15464 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:23:24.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T07:23:24.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:24.160 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T07:23:24.160 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T07:23:24.161 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.11 2024-09-21T07:23:24.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:23.969+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:24.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:23.969+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:24.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:23.969+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:24.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:23.969+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:24.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:23.969+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:24.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:23.969+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:24.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:23 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:23.969+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:24.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:24 smithi066 systemd[1]: Stopping Ceph osd.11 for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:24.851 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:24 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:24.457+0000 7f9db45da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:24.851 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:24 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:24.457+0000 7f9db45da640 -1 osd.11 78 *** Got signal Terminated *** 2024-09-21T07:23:24.851 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:24 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:24.457+0000 7f9db45da640 -1 osd.11 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T07:23:25.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:25.001+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:25.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:25.001+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:25.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:25.001+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:25.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:25.001+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:25.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:25.001+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:25.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:25.001+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:25.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:25 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:25.001+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:26.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:26.042+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:26.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:26.042+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:26.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:26.042+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:26.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:26.042+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:26.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:26.042+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:26.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:26.042+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:26.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:26 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:26.042+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:27.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:27.066+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:27.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:27.066+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:27.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:27.066+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:27.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:27.066+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:27.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:27.066+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:27.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:27.066+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:27.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:27 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:27.066+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:28.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:28.072+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:28.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:28.072+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:28.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:28.072+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:28.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:28.072+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:28.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:28.072+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:28.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:28.072+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:28.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:28 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:28.072+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:29.351 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-21T07:21:57.678831+0000 front 2024-09-21T07:21:57.679057+0000 (oldest deadline 2024-09-21T07:22:23.578781+0000) 2024-09-21T07:23:29.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-21T07:22:09.380370+0000 front 2024-09-21T07:22:09.380394+0000 (oldest deadline 2024-09-21T07:22:33.480342+0000) 2024-09-21T07:23:29.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6804 osd.2 since back 2024-09-21T07:22:17.581372+0000 front 2024-09-21T07:22:17.581503+0000 (oldest deadline 2024-09-21T07:22:42.881592+0000) 2024-09-21T07:23:29.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-21T07:22:22.882002+0000 front 2024-09-21T07:22:22.882105+0000 (oldest deadline 2024-09-21T07:22:46.982009+0000) 2024-09-21T07:23:29.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-21T07:22:31.083095+0000 front 2024-09-21T07:22:31.083195+0000 (oldest deadline 2024-09-21T07:22:56.383130+0000) 2024-09-21T07:23:29.352 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6812 osd.5 since back 2024-09-21T07:22:40.984755+0000 front 2024-09-21T07:22:40.984802+0000 (oldest deadline 2024-09-21T07:23:03.284771+0000) 2024-09-21T07:23:29.353 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-21T07:22:53.086839+0000 front 2024-09-21T07:22:53.086889+0000 (oldest deadline 2024-09-21T07:23:18.986774+0000) 2024-09-21T07:23:29.353 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11[59111]: 2024-09-21T07:23:29.074+0000 7f9db0bc5640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.66:6820 osd.8 since back 2024-09-21T07:23:04.788124+0000 front 2024-09-21T07:23:04.788090+0000 (oldest deadline 2024-09-21T07:23:28.288070+0000) 2024-09-21T07:23:30.269 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:29 smithi066 podman[69193]: 2024-09-21 07:23:29.970387151 +0000 UTC m=+5.603215214 container died 772e6411bb16634216046d1a9a4542d78bce0a002d60d7d1f1498d2fd00d1208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-21T07:23:30.601 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:30 smithi066 podman[69193]: 2024-09-21 07:23:30.348424186 +0000 UTC m=+5.981252237 container cleanup 772e6411bb16634216046d1a9a4542d78bce0a002d60d7d1f1498d2fd00d1208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T07:23:30.601 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:30 smithi066 bash[69193]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11 2024-09-21T07:23:30.851 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:30 smithi066 podman[69208]: 2024-09-21 07:23:30.599488597 +0000 UTC m=+0.620923534 container remove 772e6411bb16634216046d1a9a4542d78bce0a002d60d7d1f1498d2fd00d1208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:23:31.239 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:30 smithi066 podman[69296]: 2024-09-21 07:23:30.836331134 +0000 UTC m=+0.016119455 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T07:23:31.239 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:30 smithi066 podman[69296]: 2024-09-21 07:23:30.941982824 +0000 UTC m=+0.121771186 container create 82ac94280843c823752920db89c4106c167eb9c5051ad2178c25bb9d196b61cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T07:23:31.240 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:31 smithi066 podman[69296]: 2024-09-21 07:23:31.152718158 +0000 UTC m=+0.332506479 container init 82ac94280843c823752920db89c4106c167eb9c5051ad2178c25bb9d196b61cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:23:31.240 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:31 smithi066 podman[69296]: 2024-09-21 07:23:31.156160337 +0000 UTC m=+0.335948657 container start 82ac94280843c823752920db89c4106c167eb9c5051ad2178c25bb9d196b61cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T07:23:31.240 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:31 smithi066 podman[69296]: 2024-09-21 07:23:31.235961376 +0000 UTC m=+0.415749713 container attach 82ac94280843c823752920db89c4106c167eb9c5051ad2178c25bb9d196b61cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T07:23:31.601 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:31 smithi066 podman[69296]: 2024-09-21 07:23:31.347007696 +0000 UTC m=+0.526796025 container died 82ac94280843c823752920db89c4106c167eb9c5051ad2178c25bb9d196b61cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T07:23:31.886 INFO:journalctl@ceph.osd.11.smithi066.stdout:Sep 21 07:23:31 smithi066 podman[69319]: 2024-09-21 07:23:31.864008585 +0000 UTC m=+0.511653663 container remove 82ac94280843c823752920db89c4106c167eb9c5051ad2178c25bb9d196b61cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T07:23:31.892 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T07:23:31.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:31.934 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T07:23:31.934 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T07:23:31.934 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.a 2024-09-21T07:23:32.245 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:31 smithi029 systemd[1]: Stopping Ceph mds.a for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:32.520 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a[70291]: 2024-09-21T07:23:32.241+0000 7f7986835640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:32.520 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:32 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a[70291]: 2024-09-21T07:23:32.241+0000 7f7986835640 -1 mds.a *** got signal Terminated *** 2024-09-21T07:23:36.563 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:36 smithi029 podman[86376]: 2024-09-21 07:23:36.254050416 +0000 UTC m=+4.120215588 container died 941437d4438394afbd73abbf438b3f1020d6d28e19ed7fa3922b084da4923dd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T07:23:36.871 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:36 smithi029 podman[86376]: 2024-09-21 07:23:36.653936033 +0000 UTC m=+4.520101197 container cleanup 941437d4438394afbd73abbf438b3f1020d6d28e19ed7fa3922b084da4923dd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:23:36.871 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:36 smithi029 bash[86376]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a 2024-09-21T07:23:37.150 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T07:23:37.173 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:36 smithi029 podman[86400]: 2024-09-21 07:23:36.915012413 +0000 UTC m=+0.652833626 container remove 941437d4438394afbd73abbf438b3f1020d6d28e19ed7fa3922b084da4923dd1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T07:23:37.173 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:37 smithi029 systemd[1]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T07:23:37.173 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:37 smithi029 systemd[1]: Stopped Ceph mds.a for d3a42dd8-77e6-11ef-baf5-efdc52797490. 2024-09-21T07:23:37.173 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 21 07:23:37 smithi029 systemd[1]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.a.service: Consumed 2.466s CPU time. 2024-09-21T07:23:37.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:37.190 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T07:23:37.190 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T07:23:37.190 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.d 2024-09-21T07:23:37.530 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 21 07:23:37 smithi029 systemd[1]: Stopping Ceph mds.d for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:37.871 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 21 07:23:37 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-d[69168]: 2024-09-21T07:23:37.528+0000 7f2a21bd4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:37.871 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 21 07:23:37 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-d[69168]: 2024-09-21T07:23:37.528+0000 7f2a21bd4640 -1 mds.d *** got signal Terminated *** 2024-09-21T07:23:41.425 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 21 07:23:41 smithi029 podman[86512]: 2024-09-21 07:23:41.150087199 +0000 UTC m=+3.736679337 container died 6b5c3cfd63fc4e5addff73cf7ca24d4183614807261120c17236fc5d3026b054 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T07:23:41.792 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 21 07:23:41 smithi029 podman[86512]: 2024-09-21 07:23:41.53888339 +0000 UTC m=+4.125475516 container cleanup 6b5c3cfd63fc4e5addff73cf7ca24d4183614807261120c17236fc5d3026b054 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T07:23:41.792 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 21 07:23:41 smithi029 bash[86512]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-d 2024-09-21T07:23:41.922 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T07:23:41.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:41.959 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T07:23:41.959 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T07:23:41.959 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.g 2024-09-21T07:23:42.371 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:23:42 smithi029 systemd[1]: Stopping Ceph mds.g for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:42.371 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:23:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g[69911]: 2024-09-21T07:23:42.287+0000 7f97d7e78640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:42.371 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:23:42 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g[69911]: 2024-09-21T07:23:42.287+0000 7f97d7e78640 -1 mds.g *** got signal Terminated *** 2024-09-21T07:23:45.108 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:23:44 smithi029 podman[86632]: 2024-09-21 07:23:44.818493695 +0000 UTC m=+2.635107569 container died 982831d4212101ac2d79e4df446e8e8ca010aa763235666fc7a69e138679f541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T07:23:45.371 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:23:45 smithi029 podman[86632]: 2024-09-21 07:23:45.206210275 +0000 UTC m=+3.022824138 container cleanup 982831d4212101ac2d79e4df446e8e8ca010aa763235666fc7a69e138679f541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T07:23:45.371 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 21 07:23:45 smithi029 bash[86632]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-g 2024-09-21T07:23:45.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T07:23:45.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:45.672 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T07:23:45.672 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T07:23:45.672 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.j 2024-09-21T07:23:46.032 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:23:45 smithi029 systemd[1]: Stopping Ceph mds.j for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:46.371 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:23:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j[68791]: 2024-09-21T07:23:46.030+0000 7fb03f47c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:46.371 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:23:46 smithi029 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j[68791]: 2024-09-21T07:23:46.030+0000 7fb03f47c640 -1 mds.j *** got signal Terminated *** 2024-09-21T07:23:50.218 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:23:49 smithi029 podman[86753]: 2024-09-21 07:23:49.941197002 +0000 UTC m=+4.046214052 container died faabcc6a09e405d01e813b40ca792f8b20585a9040b053a46c038c100874bcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:23:50.585 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:23:50 smithi029 podman[86753]: 2024-09-21 07:23:50.307166462 +0000 UTC m=+4.412183512 container cleanup faabcc6a09e405d01e813b40ca792f8b20585a9040b053a46c038c100874bcba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T07:23:50.585 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 21 07:23:50 smithi029 bash[86753]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-j 2024-09-21T07:23:50.754 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T07:23:50.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:50.788 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T07:23:50.788 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T07:23:50.788 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.b 2024-09-21T07:23:51.101 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:23:50 smithi052 systemd[1]: Stopping Ceph mds.b for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:51.365 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:23:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: 2024-09-21T07:23:51.099+0000 7f0d5ef7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:51.365 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:23:51 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b[62256]: 2024-09-21T07:23:51.099+0000 7f0d5ef7d640 -1 mds.b *** got signal Terminated *** 2024-09-21T07:23:53.094 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:23:52 smithi052 podman[66797]: 2024-09-21 07:23:52.80822419 +0000 UTC m=+1.814147965 container died e0dcd70689bdced92bcec290c113bc5aa050b9724e270361fddc302377c87fa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T07:23:53.486 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:23:53 smithi052 podman[66797]: 2024-09-21 07:23:53.183737399 +0000 UTC m=+2.189661156 container cleanup e0dcd70689bdced92bcec290c113bc5aa050b9724e270361fddc302377c87fa4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:23:53.486 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 21 07:23:53 smithi052 bash[66797]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-b 2024-09-21T07:23:53.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T07:23:53.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:53.704 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T07:23:53.704 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T07:23:53.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.e 2024-09-21T07:23:54.030 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:23:53 smithi052 systemd[1]: Stopping Ceph mds.e for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:54.493 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:23:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e[61704]: 2024-09-21T07:23:54.028+0000 7fe299361640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:54.493 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:23:54 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e[61704]: 2024-09-21T07:23:54.028+0000 7fe299361640 -1 mds.e *** got signal Terminated *** 2024-09-21T07:23:57.114 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:23:56 smithi052 podman[66932]: 2024-09-21 07:23:56.806739691 +0000 UTC m=+2.884361271 container died 834b2ca3bb2dbdd5a386e40c2811092ecb57d7bab57d506a26b1613b675715f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:23:57.439 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:23:57 smithi052 podman[66932]: 2024-09-21 07:23:57.212562058 +0000 UTC m=+3.290183639 container cleanup 834b2ca3bb2dbdd5a386e40c2811092ecb57d7bab57d506a26b1613b675715f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T07:23:57.439 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 21 07:23:57 smithi052 bash[66932]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-e 2024-09-21T07:23:57.576 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T07:23:57.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:23:57.608 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T07:23:57.609 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T07:23:57.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.h 2024-09-21T07:23:57.743 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:23:57 smithi052 systemd[1]: Stopping Ceph mds.h for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:23:58.243 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:23:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h[61985]: 2024-09-21T07:23:57.932+0000 7f9d23af0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:23:58.243 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:23:57 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h[61985]: 2024-09-21T07:23:57.932+0000 7f9d23af0640 -1 mds.h *** got signal Terminated *** 2024-09-21T07:24:01.135 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:24:00 smithi052 podman[67055]: 2024-09-21 07:24:00.823867406 +0000 UTC m=+3.000136753 container died 49a5c53e6256cb911d6ac5d3404b9669cbe2f70fc0dbe84cd7296c15feef92f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T07:24:01.443 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:24:01 smithi052 podman[67055]: 2024-09-21 07:24:01.208027149 +0000 UTC m=+3.384296486 container cleanup 49a5c53e6256cb911d6ac5d3404b9669cbe2f70fc0dbe84cd7296c15feef92f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T07:24:01.444 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 21 07:24:01 smithi052 bash[67055]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-h 2024-09-21T07:24:01.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T07:24:01.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:01.622 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T07:24:01.622 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T07:24:01.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.k 2024-09-21T07:24:01.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:24:01 smithi052 systemd[1]: Stopping Ceph mds.k for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:24:01.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:24:01 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k[61419]: 2024-09-21T07:24:01.944+0000 7f6efbce5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:01.993 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:24:01 smithi052 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k[61419]: 2024-09-21T07:24:01.944+0000 7f6efbce5640 -1 mds.k *** got signal Terminated *** 2024-09-21T07:24:05.106 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:24:04 smithi052 podman[67175]: 2024-09-21 07:24:04.823313201 +0000 UTC m=+2.984071188 container died 2116dc47abe42c5948f2381f9fe3a6dc5c1359aafda1de17d433be7c2bb71e78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:24:05.431 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:24:05 smithi052 podman[67175]: 2024-09-21 07:24:05.195690414 +0000 UTC m=+3.356448398 container cleanup 2116dc47abe42c5948f2381f9fe3a6dc5c1359aafda1de17d433be7c2bb71e78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T07:24:05.431 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 21 07:24:05 smithi052 bash[67175]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-k 2024-09-21T07:24:05.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T07:24:05.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:05.594 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T07:24:05.595 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T07:24:05.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.c 2024-09-21T07:24:05.907 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:24:05 smithi066 systemd[1]: Stopping Ceph mds.c for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:24:06.351 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:24:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c[64222]: 2024-09-21T07:24:05.905+0000 7fbedf81a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:06.351 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:24:05 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c[64222]: 2024-09-21T07:24:05.905+0000 7fbedf81a640 -1 mds.c *** got signal Terminated *** 2024-09-21T07:24:09.101 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:24:08 smithi066 podman[69397]: 2024-09-21 07:24:08.843667001 +0000 UTC m=+3.046259555 container died 543836303f1a54b9bd4b18638afdb54840b60c1527df4da35ea610e5d1781c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T07:24:09.366 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:24:09 smithi066 podman[69397]: 2024-09-21 07:24:09.188713274 +0000 UTC m=+3.391305828 container cleanup 543836303f1a54b9bd4b18638afdb54840b60c1527df4da35ea610e5d1781c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T07:24:09.367 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:24:09 smithi066 bash[69397]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c 2024-09-21T07:24:09.625 INFO:journalctl@ceph.mds.c.smithi066.stdout:Sep 21 07:24:09 smithi066 podman[69421]: 2024-09-21 07:24:09.365258184 +0000 UTC m=+0.516414888 container remove 543836303f1a54b9bd4b18638afdb54840b60c1527df4da35ea610e5d1781c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T07:24:09.630 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T07:24:09.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:09.667 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T07:24:09.667 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T07:24:09.667 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.f 2024-09-21T07:24:09.986 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:24:09 smithi066 systemd[1]: Stopping Ceph mds.f for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:24:10.351 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:24:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f[63950]: 2024-09-21T07:24:09.983+0000 7f7c51007640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:10.351 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:24:09 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f[63950]: 2024-09-21T07:24:09.983+0000 7f7c51007640 -1 mds.f *** got signal Terminated *** 2024-09-21T07:24:13.101 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:24:12 smithi066 podman[69528]: 2024-09-21 07:24:12.819510023 +0000 UTC m=+2.928077788 container died 29fd867fb3be5eb48143f77c26720524620c4aaeaffc09f2725f5a370cc097df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T07:24:13.553 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:24:13 smithi066 podman[69528]: 2024-09-21 07:24:13.312331486 +0000 UTC m=+3.420899238 container cleanup 29fd867fb3be5eb48143f77c26720524620c4aaeaffc09f2725f5a370cc097df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T07:24:13.553 INFO:journalctl@ceph.mds.f.smithi066.stdout:Sep 21 07:24:13 smithi066 bash[69528]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-f 2024-09-21T07:24:13.692 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T07:24:13.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:13.727 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T07:24:13.727 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T07:24:13.728 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.i 2024-09-21T07:24:14.101 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:24:13 smithi066 systemd[1]: Stopping Ceph mds.i for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:24:14.101 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:24:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i[64504]: 2024-09-21T07:24:14.045+0000 7f1eebcc3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:14.101 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:24:14 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i[64504]: 2024-09-21T07:24:14.045+0000 7f1eebcc3640 -1 mds.i *** got signal Terminated *** 2024-09-21T07:24:17.097 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:24:16 smithi066 podman[69647]: 2024-09-21 07:24:16.827347951 +0000 UTC m=+2.878701337 container died a44ed3600f5a4d4180b92f5629e35ef7aa414a5628973f8102635388ea8db60b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T07:24:17.351 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:24:17 smithi066 podman[69647]: 2024-09-21 07:24:17.195853656 +0000 UTC m=+3.247207040 container cleanup a44ed3600f5a4d4180b92f5629e35ef7aa414a5628973f8102635388ea8db60b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T07:24:17.351 INFO:journalctl@ceph.mds.i.smithi066.stdout:Sep 21 07:24:17 smithi066 bash[69647]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-i 2024-09-21T07:24:17.587 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T07:24:17.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:17.620 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T07:24:17.620 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T07:24:17.621 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.l 2024-09-21T07:24:17.700 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:24:17 smithi066 systemd[1]: Stopping Ceph mds.l for d3a42dd8-77e6-11ef-baf5-efdc52797490... 2024-09-21T07:24:18.029 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:24:17 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l[63683]: 2024-09-21T07:24:17.940+0000 7ff8d9e2e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T07:24:18.029 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:24:17 smithi066 ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l[63683]: 2024-09-21T07:24:17.940+0000 7ff8d9e2e640 -1 mds.l *** got signal Terminated *** 2024-09-21T07:24:21.101 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:24:20 smithi066 podman[69768]: 2024-09-21 07:24:20.842722414 +0000 UTC m=+3.001667588 container died 979f5ce93d60ee0a5e035731f68eaea413ecc439171f43f93a8ad6c6e130be74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T07:24:21.543 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:24:21 smithi066 podman[69768]: 2024-09-21 07:24:21.29113399 +0000 UTC m=+3.450079162 container cleanup 979f5ce93d60ee0a5e035731f68eaea413ecc439171f43f93a8ad6c6e130be74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T07:24:21.543 INFO:journalctl@ceph.mds.l.smithi066.stdout:Sep 21 07:24:21 smithi066 bash[69768]: ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490-mds-l 2024-09-21T07:24:21.687 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-d3a42dd8-77e6-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T07:24:21.761 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T07:24:21.761 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T07:24:21.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:24:21.973 INFO:teuthology.orchestra.run.smithi029.stdout:Deleting cluster with fsid: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:24:24.576 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:24:24.787 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:24:27.278 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T07:24:27.492 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:24:29.978 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:30.013 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:30.045 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T07:24:30.073 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T07:24:30.075 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi029/crash 2024-09-21T07:24:30.076 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:24:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:24:30.105 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:24:30.107 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi052/crash 2024-09-21T07:24:30.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:24:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:24:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:24:30.153 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi066/crash 2024-09-21T07:24:30.154 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash -- . 2024-09-21T07:24:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:tar: /var/lib/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T07:24:30.196 INFO:teuthology.orchestra.run.smithi066.stderr:tar: Error is not recoverable: exiting now 2024-09-21T07:24:30.198 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T07:24:30.198 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T07:24:30.242 INFO:teuthology.orchestra.run.smithi029.stdout:2024-09-21T07:21:24.693054+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:24:30.243 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-21T07:24:30.243 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[SEC\]' /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T07:24:30.322 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]' /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T07:24:30.399 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[WRN\]' /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T07:24:30.475 INFO:teuthology.orchestra.run.smithi029.stdout:2024-09-21T07:21:24.693054+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-21T07:24:30.475 INFO:tasks.cephadm:Compressing logs... 2024-09-21T07:24:30.476 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:24:30.518 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:24:30.520 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:24:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T07:24:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:: No such file or directory 2024-09-21T07:24:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T07:24:30.541 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:24:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:24:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T07:24:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:24:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T07:24:30.543 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.a.log: /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T07:24:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.a.log: 82.5% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:24:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T07:24:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:24:30.546 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T07:24:30.550 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:: No such file or directory 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T07:24:30.552 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T07:24:30.553 INFO:teuthology.orchestra.run.smithi066.stderr: 82.4% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:24:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T07:24:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:24:30.553 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T07:24:30.553 INFO:teuthology.orchestra.run.smithi066.stderr: 90.4% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:24:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T07:24:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T07:24:30.554 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T07:24:30.555 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log: 86.8% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:24:30.555 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T07:24:30.555 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T07:24:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log: 82.5% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T07:24:30.556 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log 2024-09-21T07:24:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T07:24:30.557 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log: 90.8% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:24:30.558 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T07:24:30.559 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.d.log: 86.8% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:24:30.561 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:24:30.562 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T07:24:30.563 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.y.log: 92.5% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T07:24:30.563 INFO:teuthology.orchestra.run.smithi052.stderr: 90.9% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T07:24:30.564 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T07:24:30.565 INFO:teuthology.orchestra.run.smithi029.stderr: 95.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T07:24:30.566 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T07:24:30.566 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T07:24:30.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T07:24:30.567 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.h.log: 86.8% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T07:24:30.571 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.z.log: 92.6% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T07:24:30.571 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T07:24:30.574 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.j.log: 95.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T07:24:30.574 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:24:30.581 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T07:24:30.591 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:24:30.592 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:24:30.593 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T07:24:30.605 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:24:30.608 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T07:24:30.638 INFO:teuthology.orchestra.run.smithi029.stderr: 94.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T07:24:30.638 INFO:teuthology.orchestra.run.smithi029.stderr: 94.4% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T07:24:30.646 INFO:teuthology.orchestra.run.smithi052.stderr: 94.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T07:24:30.647 INFO:teuthology.orchestra.run.smithi066.stderr: 94.4% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T07:24:30.664 INFO:teuthology.orchestra.run.smithi066.stderr: 93.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T07:24:30.669 INFO:teuthology.orchestra.run.smithi052.stderr: 93.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T07:24:30.674 INFO:teuthology.orchestra.run.smithi066.stderr: 92.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T07:24:30.695 INFO:teuthology.orchestra.run.smithi052.stderr: 93.2% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T07:24:30.784 INFO:teuthology.orchestra.run.smithi029.stderr: 90.4% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T07:24:30.957 INFO:teuthology.orchestra.run.smithi066.stderr: 91.8% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T07:24:30.980 INFO:teuthology.orchestra.run.smithi052.stderr: 92.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T07:24:31.814 INFO:teuthology.orchestra.run.smithi029.stderr: 90.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T07:24:33.029 INFO:teuthology.orchestra.run.smithi029.stderr: 93.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T07:24:33.351 INFO:teuthology.orchestra.run.smithi066.stderr: 93.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T07:24:33.530 INFO:teuthology.orchestra.run.smithi029.stderr: 93.2% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T07:24:33.836 INFO:teuthology.orchestra.run.smithi052.stderr: 93.2% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T07:24:33.860 INFO:teuthology.orchestra.run.smithi052.stderr: 93.1% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T07:24:33.891 INFO:teuthology.orchestra.run.smithi066.stderr: 93.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T07:24:34.054 INFO:teuthology.orchestra.run.smithi052.stderr: 93.2% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T07:24:34.075 INFO:teuthology.orchestra.run.smithi029.stderr: 93.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T07:24:34.141 INFO:teuthology.orchestra.run.smithi066.stderr: 93.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T07:24:34.364 INFO:teuthology.orchestra.run.smithi029.stderr: 93.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T07:24:34.366 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-21T07:24:34.366 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m3.835s 2024-09-21T07:24:34.366 INFO:teuthology.orchestra.run.smithi029.stderr:user 0m14.016s 2024-09-21T07:24:34.366 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m0.492s 2024-09-21T07:24:34.794 INFO:teuthology.orchestra.run.smithi066.stderr: 93.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T07:24:35.086 INFO:teuthology.orchestra.run.smithi052.stderr: 93.4% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T07:24:37.297 INFO:teuthology.orchestra.run.smithi066.stderr: 97.3% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T07:24:37.298 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-21T07:24:37.299 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m6.763s 2024-09-21T07:24:37.299 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m20.609s 2024-09-21T07:24:37.299 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m0.748s 2024-09-21T07:25:45.804 INFO:teuthology.orchestra.run.smithi052.stderr: 95.0% -- replaced with /var/log/ceph/d3a42dd8-77e6-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T07:25:45.805 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-21T07:25:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:real 1m15.270s 2024-09-21T07:25:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:user 1m27.558s 2024-09-21T07:25:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m2.883s 2024-09-21T07:25:45.806 INFO:tasks.cephadm:Archiving logs... 2024-09-21T07:25:45.806 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi029/log 2024-09-21T07:25:45.807 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:25:47.771 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi052/log 2024-09-21T07:25:47.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:25:58.418 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi066/log 2024-09-21T07:25:58.419 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:26:00.768 INFO:tasks.cephadm:Removing cluster... 2024-09-21T07:26:00.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 --force 2024-09-21T07:26:00.982 INFO:teuthology.orchestra.run.smithi029.stdout:Deleting cluster with fsid: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:26:01.273 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 --force 2024-09-21T07:26:01.484 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:26:01.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid d3a42dd8-77e6-11ef-baf5-efdc52797490 --force 2024-09-21T07:26:02.053 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: d3a42dd8-77e6-11ef-baf5-efdc52797490 2024-09-21T07:26:02.341 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T07:26:02.341 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:26:02.362 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:26:02.379 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T07:26:02.396 INFO:tasks.cephadm:Teardown complete 2024-09-21T07:26:02.396 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T07:26:02.406 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T07:26:02.406 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:26:02.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:26:02.423 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:26:02.533 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T07:26:02.544 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T07:26:02.545 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:26:02.547 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:26:02.549 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:26:02.562 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:26:02.563 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:26:02.564 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:26:02.566 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:26:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-21T07:26:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 51 +60us[ +82us] +/- 51ms 2024-09-21T07:26:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -151us[ -129us] +/- 61ms 2024-09-21T07:26:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +154us[ +154us] +/- 66ms 2024-09-21T07:26:02.567 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:26:02.568 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:26:02.568 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-21T07:26:02.569 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +58us[ +76us] +/- 51ms 2024-09-21T07:26:02.569 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -160us[ -143us] +/- 61ms 2024-09-21T07:26:02.569 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 +160us[ +177us] +/- 66ms 2024-09-21T07:26:02.569 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:26:02.570 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:26:02.570 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-21T07:26:02.570 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +80us[ +94us] +/- 51ms 2024-09-21T07:26:02.570 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -157us[ -157us] +/- 61ms 2024-09-21T07:26:02.570 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +176us[ +176us] +/- 66ms 2024-09-21T07:26:02.570 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:26:02.570 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T07:26:02.580 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T07:26:02.580 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T07:26:02.589 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:26:02.689 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:26:02.758 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:26:02.826 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:26:02.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:26:02.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:26:02.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:26:02.887 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T07:26:02.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:26:02.916 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T07:26:02.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T07:26:03.019 INFO:teuthology.task.internal:Duration was 2054.219725 seconds 2024-09-21T07:26:03.020 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T07:26:03.029 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T07:26:03.029 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:26:03.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:26:03.034 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:26:03.072 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:26:03.073 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:26:03.075 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:26:03.533 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T07:26:03.533 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-09-21T07:26:03.533 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:26:03.556 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-21T07:26:03.557 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:26:03.597 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-09-21T07:26:03.597 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:26:03.621 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T07:26:03.621 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:26:03.624 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:26:03.641 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:26:03.689 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T07:26:03.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:26:03.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:26:03.710 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:26:04.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T07:26:04.260 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T07:26:04.260 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:26:04.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:26:04.312 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:26:04.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T07:26:04.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:26:04.352 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:26:04.355 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:26:04.374 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-09-21T07:26:04.376 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-21T07:26:04.403 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-09-21T07:26:04.439 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:26:04.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:26:04.454 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:26:04.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:26:04.469 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:26:04.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:26:04.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T07:26:04.505 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T07:26:04.506 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi029 2024-09-21T07:26:04.506 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:26:04.552 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi052 2024-09-21T07:26:04.552 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:26:04.587 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913575/remote/smithi066 2024-09-21T07:26:04.587 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:26:04.623 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T07:26:04.623 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:26:04.626 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:26:04.631 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:26:04.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T07:26:04.685 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T07:26:04.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T07:26:04.696 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T07:26:04.696 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:26:04.699 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:26:04.701 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:26:04.712 INFO:teuthology.orchestra.run.smithi029.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:26 /home/ubuntu/cephtest 2024-09-21T07:26:04.713 INFO:teuthology.orchestra.run.smithi052.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:26 /home/ubuntu/cephtest 2024-09-21T07:26:04.728 INFO:teuthology.orchestra.run.smithi066.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:26 /home/ubuntu/cephtest 2024-09-21T07:26:04.729 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T07:26:04.740 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T07:26:04.765 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} duration: 2054.219725370407 failure_reason: '"2024-09-21T07:21:24.693054+0000 mon.a (mon.0) 1224 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2024-09-21T07:26:04.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:26:04.848 INFO:teuthology.run:FAIL